Moving picture coding method, moving picture coding apparatus, moving picture decoding method, and moving picture decoding apparatus

ABSTRACT

Obtaining one or more motion vector predictor candidates includes: (a1) generating a motion vector predictor candidate, based on motion vectors of first adjacent blocks adjacent to a block to be processed in a first direction; and (a2) generating a motion vector predictor candidate, based on motion vectors of second adjacent blocks adjacent to the block to be processed in a second direction, and step (a2) (S 500 ) includes: (S 520 ) determining whether the first adjacent blocks include an inter-predicted block; and (S 530 ) searching for a motion vector on which scaling processing can be performed from among the motion vectors of the second adjacent blocks when it is determined that the first adjacent blocks do not include an inter-predicted block, and executing, when the motion vector on which scaling processing can be performed is obtained in the search, scaling processing on the motion vector obtained in the search.

CROSS REFERENCE TO RELATED APPLICATION

The present application is a divisional of application Ser. No.13/666,265, filed Nov. 1, 2012, which claims the benefit of U.S.Provisional Patent Application No. 61/554,598 filed Nov. 2, 2011. Theentire disclosures of the above-identified applications, including thespecification, drawings and claims are incorporated herein by referencein their entirety.

FIELD

The present disclosure relates to a moving picture coding method, amoving picture coding apparatus, a moving picture decoding method, and amoving picture decoding apparatus.

BACKGROUND

In moving picture coding processing, in general, the amount ofinformation is reduced by utilizing redundancy in the spatial directionand the temporal direction which moving pictures have. Here, in general,transform to a frequency domain is used as a method utilizing redundancyin the spatial direction. Further, inter-picture prediction(hereinafter, referred to as “inter prediction”) coding processing isused as a method utilizing redundancy in the temporal direction. Ininter prediction coding processing, when a picture is coded, a codedpicture that appears before or after a current picture to be coded inthe display time order is used as a reference picture. A motion vectoris derived by performing motion detection on the current picturerelative to the reference picture. Then, redundancy in the temporaldirection is eliminated by calculating a difference between image dataof the current picture and predicted image data obtained by motioncompensation based on the derived motion vector.

CITATION LIST Non Patent Literature

-   [NPL 1] ITU-T H.264“8.4.1 Derivation process for motion vector    components and reference indices” March, 2010, Expressions (8-174)    and (8-175)-   [NPL 2] JCTVC-F803_d2 “WD4: Working Draft 4 of High-Efficiency Video    Coding”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T    SG16 WP3 and ISO/IEC JTC1/SC29/WG11 6th Meeting, Torino, IT, 14 to    22 Jul. 2011

SUMMARY Technical Problem

There is a demand, however, for the above conventional technique toachieve an increase in processing speed in coding and decoding a movingpicture using inter prediction.

In view of this, an object of the present disclosure is to provide amoving picture coding method and a moving picture decoding method forallowing an increase in the processing speed of coding and decoding amoving picture using inter prediction.

Solution to Problem

A moving picture coding method according to an aspect of the presentdisclosure is a moving picture decoding method for decoding a currentblock included in a bitstream, using a motion vector predictor used whendecoding a motion vector of the current block, the method including: (a)obtaining one or more motion vector predictor candidates which arecandidates for the motion vector predictor; (b) decoding a coded indexfor identifying one of the one or more motion vector predictorcandidates, the coded index being added to the bitstream; and (c)selecting, based on the decoded index, the motion vector predictor to beused for decoding the current block from among the one or more motionvector predictor candidates, wherein step (a) includes: (a1) generatinga motion vector predictor candidate, based on plural motion vectors ofplural first adjacent blocks adjacent to the current block in a firstdirection; and (a2) generating a motion vector predictor candidate,based on plural motion vectors of plural second adjacent blocks adjacentto the current block in a second direction, and step (a2) includes: (i)determining whether the plural first adjacent blocks include one or moreinter-predicted blocks; and (ii) searching for a motion vector to bemade available by scaling processing from among the plural motionvectors of the plural second adjacent blocks when it is determined instep (i) that the plural first adjacent blocks do not include aninter-predicted block, and generating, when the motion vector isobtained in the search, one of the one or more motion vector predictorcandidates by executing scaling processing on the motion vector obtainedin the search.

It should be noted that these general and specific aspects may beimplemented using a system, a method, an integrated circuit, a computerprogram, a computer-readable recording medium such as a CD-ROM, or anycombination of systems, methods, integrated circuits, computer programsor recording media.

Further benefits and advantages provided by the disclosed embodimentsbecome clear from the specification and the drawings. Those benefits andadvantages may be individually achieved by the features of variousembodiments, the specification, and the drawings, and all the featuresdo not necessarily need to be provided to obtain at least one benefit oradvantage.

Advantageous Effects

Provided is a moving picture coding method and a moving picture decodingmethod for allowing an increase in the processing speed of coding anddecoding a moving picture using inter prediction.

BRIEF DESCRIPTION OF DRAWINGS

These and other objects, advantages and features of the disclosure willbecome apparent from the following description thereof taken inconjunction with the accompanying drawings that illustrate a specificembodiment of the present disclosure.

FIG. 1 is a conceptual diagram illustrating a relationship among amotion vector, a motion vector predictor, and a motion vector differencewhich are used to generate a predicted image.

FIG. 2 is a block diagram illustrating an example of a configuration ofa moving picture coding apparatus.

FIG. 3 is a flowchart illustrating an example of a moving picture codingmethod.

FIG. 4A illustrates a relationship between coding block units CU (codingunit) and prediction block units PU (prediction unit).

FIG. 4B illustrates a relationship between a coding unit tree andpred_type.

FIG. 4C illustrates an interpretation table for values of pred_type.

FIG. 5 illustrates a positional relationship between a current block tobe predicted and adjacent blocks adjacent to the current block.

FIG. 6A illustrates a candidate list mvpListL0 of motion vectorpredictors.

FIG. 6B illustrates a candidate list mvpListL1 of motion vectorpredictors.

FIG. 7 is a conceptual diagram illustrating a relationship betweenmotion vector predictor candidates included in a candidate listmvpListLX.

FIG. 8 is a flowchart illustrating a procedure of creating a candidatelist mvpListLX according to Comparative Example.

FIG. 9A is a flowchart illustrating a detailed processing procedure ofstep S410 in FIG. 8.

FIG. 9B is a flowchart illustrating a detailed processing procedure ofstep S430 in FIG. 8.

FIG. 10A is a flowchart illustrating a detailed procedure of step S510in FIG. 8.

FIG. 10B is a flowchart illustrating a detailed procedure of step S530in FIG. 8.

FIG. 11 is a flowchart illustrating a detailed procedure of step S240 inFIG. 3.

FIG. 12 is a flowchart illustrating a detailed procedure of step S250 inFIG. 3.

FIG. 13 illustrates a problem of mvpListLX generation processing.

FIG. 14 illustrates a method for generating mvpListLX used by a movingpicture coding apparatus according to Embodiment 1.

FIG. 15 is a block diagram illustrating a configuration of a movingpicture decoding apparatus according to Embodiment 2.

FIG. 16 is a flowchart illustrating a moving picture decoding methodaccording to Embodiment 2.

FIG. 17 is a flowchart illustrating a procedure of creating a candidatelist mvpListLX in Embodiment 2.

FIG. 18 sequentially illustrates a procedure of creating the candidatelist mvpListLX in Embodiment 2.

FIG. 19 illustrates a determination result obtained in steps S620 andS820 when a current block to be predicted is PU0.

FIG. 20 illustrates a determination result obtained in steps S620 andS820 when a current block to be predicted is PU1.

FIG. 21 is a partial flowchart illustrating a procedure of creating thecandidate list mvpListLX in Variation 1.

FIG. 22 is a flowchart illustrating a procedure of creating thecandidate list mvpListLX in Variation 2.

FIG. 23 sequentially illustrates a procedure of creating the candidatelist mvpListLX in Variation 2.

FIG. 24 shows an overall configuration of a content providing system forimplementing content distribution services.

FIG. 25 shows an overall configuration of a digital broadcasting system.

FIG. 26 shows a block diagram illustrating an example of a configurationof a television.

FIG. 27 shows a block diagram illustrating an example of a configurationof an information reproducing/recording unit that reads and writesinformation from and on a recording medium that is an optical disk.

FIG. 28 shows an example of a configuration of a recording medium thatis an optical disk.

FIG. 29A shows an example of a cellular phone.

FIG. 29B is a block diagram showing an example of a configuration of acellular phone.

FIG. 30 illustrates a structure of multiplexed data.

FIG. 31 schematically shows how each stream is multiplexed inmultiplexed data.

FIG. 32 shows how a video stream is stored in a stream of PES packets inmore detail.

FIG. 33 shows a structure of TS packets and source packets in themultiplexed data.

FIG. 34 shows a data structure of a PMT.

FIG. 35 shows an internal structure of multiplexed data information.

FIG. 36 shows an internal structure of stream attribute information.

FIG. 37 shows steps for identifying video data.

FIG. 38 shows an example of a configuration of an integrated circuit forimplementing the moving picture coding method and the moving picturedecoding method according to each of embodiments.

FIG. 39 shows a configuration for switching between driving frequencies.

FIG. 40 shows steps for identifying video data and switching betweendriving frequencies.

FIG. 41 shows an example of a look-up table in which video datastandards are associated with driving frequencies.

FIG. 42A is a diagram showing an example of a configuration for sharinga module of a signal processing unit.

FIG. 42B is a diagram showing another example of a configuration forsharing a module of the signal processing unit.

DESCRIPTION OF EMBODIMENTS

(Underlying Knowledge Forming Basis of the Present Disclosure)

In H.264, three picture types, namely, I-picture, P-picture, andB-picture are used to compress the amount of information.

An I-picture is not coded by inter prediction coding processing.Specifically, an I-picture is coded by intra-picture prediction(hereinafter, referred to as intra prediction) coding processing. AP-picture is coded by inter prediction coding by referring to onealready coded picture that appears before or after a current picture tobe coded in the display time order. A B-picture is coded by interprediction coding by referring to two already coded pictures that appearbefore (e.g., in a prediction direction 0) or after (e.g., in aprediction direction 1) the current picture in the display time order.

Various considerations are being made regarding a motion vector derivingmethod used for inter prediction coding processing on a moving picture.Examples of the motion vector deriving method include the methods below.

The first motion vector deriving method is an H.264 direct mode fordirectly deriving a motion detection vector (motion vector) from coded(decoded) data, without obtaining information from a code string.

The second motion vector deriving method is a method for deriving amotion vector v (motion vector) to be used for inter prediction byadding a motion vector difference d obtained from a code string to amotion vector predictor p (see Expressions (8-174) and (8-175) in NPL 1,for instance). It should be noted that the motion vector difference d isa difference vector between the motion vector v and the motion vectorpredictor p.

Here, FIG. 1 is a conceptual diagram illustrating a relationship amongthe motion vector v (mvLX), the motion vector predictor p (mvpLX), andthe motion vector difference d (mvdLX) in the second H.264 motion vectorderiving method. It should be noted that calculation is performedseparately for first components (e.g., horizontal components) and secondcomponents (e.g., vertical components) in the example illustrated inFIG. 1.

At the time of decoding, the motion vector mvLX is reconstructed byexecuting the calculation of Expressions 1 and 2 below for respectivecomponents.

For a first component:mvLX[0]=mvpLX[0]+mvdLX[0]  (Expression 1)

For a second component:mvLX[1]=mvpLX[1]+mvdLX[1]  (Expression 2)

At the time of coding, first, a motion vector mvLX (mvLX [0], mvLX [1])is determined through search in view of coding efficiency (and alsorefIdxLX for identifying a reference image). Furthermore, calculationsrepresented by Expressions 3 and 4 below are performed in order toobtain a motion vector difference mvdLX which is information necessaryfor reconstructing the motion detection vector mvLX.

For a first component:mvdLX[0]=mvLX[0]−mvpLX[0]  (Expression 3)

For a second component:mvdLX[1]=mvLX[1]−mvpLX[1]  (Expression 4)

At the time of coding, the two-dimensional motion vector differencemvdLX (mvdLX [0], mvdLX [1]) obtained by the above calculations iscoded.

The following is a description of a moving picture coding method and amoving picture coding apparatus according to Comparative Example, basedon FIGS. 2 to 5.

EX1 Configuration of Moving Picture Coding Apparatus According toComparative Example

FIG. 2 is a block diagram illustrating an example of a configuration ofthe moving picture coding apparatus according to Comparative Example.

As illustrated in FIG. 2, a moving picture coding apparatus 100 includesa difference unit 101, a transform unit 102, a quantization unit 103, anentropy coding unit 110, an inverse quantization unit 104, an inversetransform unit 105, an addition unit 106, a memory 109, an intra/interprediction unit 107, and a coding control unit 108.

The difference unit 101 generates a residual signal by subtracting apredicted image signal from an input image signal for each block. Thedifference unit 101 outputs the residual signal to the transform unit102.

The transform unit 102 transforms the residual signal from an imagedomain into a frequency domain. The quantization unit 103 performsquantization processing on the residual signal which has beentransformed into the frequency domain. The quantization unit 103 outputsthe quantized residual signal which is a residual signal on whichquantization processing has been performed to the inverse quantizationunit 104 and the entropy coding portion 110.

The entropy coding unit 110 performs entropy coding processing on thequantized residual signal, a decoding control signal, and the like, togenerate a coded bitstream. A decoding control signal includes aprediction direction flag, picture type information, a control parametersuch as a motion vector difference d, for example.

The inverse quantization unit 104 performs inverse quantizationprocessing on the quantized residual signal on which quantizationprocessing has been performed by the quantization unit 103. The inversetransform unit 105 transforms the quantized residual signal (residualsignal) on which inverse quantization processing has been performed fromthe frequency domain into the image domain, and outputs a reconstructedresidual signal.

The addition unit 106 adds a reconstructed residual signal and apredicted image signal for each block to be coded, thereby generating areconstructed image signal.

A reconstructed image signal is stored on a frame-by-frame basis in thememory 109.

The intra/inter prediction unit 107 stores a reconstructed image signalin a memory in predetermined units, such as frame units and block units.In addition, the intra/inter prediction unit 107 generates a predictedimage signal (a pixel value derived based on a reconstructed imagesignal and a motion vector), based on an instruction from the codingcontrol unit 108 described below. The intra/inter prediction unit 107outputs the generated predicted image signal to the difference unit 101and the addition unit 106.

The coding control unit 108 determines which control parameter is to beused for coding a picture (input image signal), after making trials. Thecoding control unit 108 outputs, from among plural control parameters, acontrol parameter (coding control information) necessary for coding tothe intra/inter prediction unit 107. More specifically, for example, asshown by the dotted lines in FIG. 1, the coding control unit 108 obtainsa coded bitstream, determines plural control parameters (e.g., fordistinguishing between inter prediction and intra prediction, etc.) sothat the bit length of the obtained coded bitstream is shortened.

In addition, the coding control unit 108 extracts a control parameter(decoding control information) necessary for decoding from the pluralcontrol parameters, and outputs the extracted parameter to the entropycoding unit 110. Examples of decoding control information includepred_type, mvp_idx_lx, mvdLX, and the like. For each coding block unitCU, pred_type is set, and specifies a prediction mode (fordistinguishing between inter prediction and intra prediction), and thepartitioned shape of a coding block unit CU (partitioning type). Thedetails of pred_type are described below. A motion vector predictorindex for designating a candidate to be used as a motion vectorpredictor from a candidate list is indicated by mvp_idx_lx. A motionvector difference is indicated by mvdLX, as mentioned above.

EX2 Processing Operation of Moving Picture Coding Apparatus According toComparative Example

Next is a description of the moving picture coding method executed bythe moving picture coding apparatus 100 described above, based on FIGS.3 and 4A.

FIG. 3 is a flowchart showing a processing procedure of a method forgenerating a predicted image by inter prediction coding (moving picturecoding method) executed by the moving picture coding apparatus 100described above.

It should be noted that a predicted image is generated per predictionblock unit PU. Here, a description is given of the case where the sizeof a prediction block unit PU is smaller than a coding block unit CU, asan example.

FIG. 4A illustrates a relationship between the prediction block unit PUand the coding block unit CU. In FIG. 4A, the solid line frame indicatesthe coding block unit CU, and the broken line frame indicates theprediction block unit PU. The slice (picture) type is B. One slice isdivided into four blocks having the same size in FIG. 4A. Furthermore,the upper right block is further divided into four. These blocks arecoding block units CU.

Furthermore, in FIG. 4A, the coding block units CU are numbered in theorder 0, 1, 2, and so on for each depth level of a tree hierarchy called“coding tree”. The numbers correspond to the coding processing order.Specifically, CU0, CU10 to CU13, CU2, and CU3 are given to the upperleft block, the upper right blocks, the bottom left block, and thebottom right block, respectively.

FIG. 4B illustrates a relationship between pred_type and a coding unittree obtained from a code string based on coding tree syntax, withregard to the coding block units CU illustrated in FIG. 4A. Whatpred_type indicates can be determined in accordance with the tableillustrated in FIG. 4C, for example.

FIG. 4C is an interpretation table showing values of pred_type. Forexample, if the slice type is P or B, and the value of pred_type is 2,the prediction mode of the coding block unit CU is MODE_INTER, and thepartitioned shape of the coding block unit CU is N×2N. The coding blockunit CU12 in FIG. 4A corresponds to this unit, for example. In addition,for example, if the slice type is P or B, and the value of pred_type is8, the prediction mode of the coding block unit CU is MODE_INTRA, andthe partitioned shape of the coding block unit CU is 2N×2N. The codingblock unit CU0 in FIG. 4A corresponds to this unit, for example.

The following is a description of the case where a current block to becoded is CU12, as an example. As mentioned above, the prediction mode ofthe current block CU12 is MODE_INTER, and the current block CU12includes two prediction block units PU, namely, PU0 and PU1 (N×2N). Itshould be noted that in FIG. 4B, the area enclosed by the one-pointdashed line is an area having information which is already “available”at the point in time when coding the prediction block unit PU0 of thecurrent block CU12. As illustrated in FIG. 4B, in Comparative Example,the coding block units CU2 and CU3 are not “available” at the point intime when coding the current block CU12.

Now referring to FIG. 3, in step S200, the coding control unit 108derives a motion vector mvLX of a current block to be predicted bymotion detection.

In step S210, the coding control unit 108 generates motion vectorpredictor candidate lists (mvpListLX) for each prediction block unit (PUunit) included in a current block to be coded (Curr_Blk) (mvpListLXgeneration step). It should be noted that the candidate list mvpListLXis generated for each prediction block unit PU. In addition, twocandidate lists, namely, a candidate list mvpListL0 corresponding to theprediction direction 0 and a candidate list mvpListL1 corresponding tothe prediction direction 1 are generated for each prediction block unitPU.

FIG. 5 illustrates the positional relationship of a current block to bepredicted (currentPU, current prediction block unit PU) and adjacentblocks. In FIG. 5, plural adjacent blocks are divided into two blockgroups A and B (hereinafter, referred to as “group A” and “group B” forshort in the drawings, as appropriate). The block group A includes anadjacent block A0 on the left of the current block, and an adjacentblock A1 on the bottom-left of the current block. The block group Bincludes an adjacent block B2 on the upper left of the current block, anadjacent block B1 on the upper side of the current block, and anadjacent block B0 on the upper right of the current block.

It should be noted that in FIG. 4A, when the prediction block unit PU0included in the coding block unit CU12 is a current block to bepredicted, a block corresponding to the adjacent block A1 is theprediction block unit PU3 included in the coding block unit CU0, and theblock corresponding to the adjacent block A0 is the prediction blockunit PU included in the coding block unit CU2.

A description is given of motion vector predictor candidate listsgenerated by the coding control unit 108, with reference to FIGS. 6A and6B. FIG. 6A illustrates the candidate list mvpListL0 for coding motionvector predictors in the prediction direction 0. FIG. 6B illustrates thecandidate list mvpListL1 for coding motion vector predictors in theprediction direction 1. N is an index indicating a block group.

FIGS. 6A and 6B show the case where the size of the candidate lists is2, and one candidate is derived from each of the block groups A and Billustrated in FIG. 5. It should be noted that the case where nocandidate is derived from the block groups A and B is not intended to beexcluded. A detailed description of a method for deriving the candidatelists will be given below.

Now, referring back to FIG. 3, in step S230, the coding control unit 108performs update processing on mvpListLX (update step). The codingcontrol unit 108 adds an entry, duplicates a candidate included in alist, deletes a candidate, and the like as the update processing, forexample. The rule for the update processing is shared between the movingpicture coding apparatus 100 and a moving picture decoding apparatus 300described below.

In step S240, the coding control unit 108 determines coding controlinformation including the value of mvp_idx_lx for each prediction blockunit PU (determination step).

“mvp_idx_lx” is a motion vector predictor index which indicates a motionvector predictor candidate for coding a motion vector in the predictiondirection X. Here, FIG. 7 illustrates a relationship among eachcandidate in the motion vector predictor candidate list mvpListLX, themotion vector mvLX, and the motion vector difference mvdLX. It should benoted that FIG. 7 shows mvpListLX [n_mvp_idx] which is not determined tobe the motion vector predictor mvpLX, for reference. The motion vectormvLX is a motion vector derived through motion detection by the codingcontrol unit 108 in step S200. In the present embodiment, the codingcontrol unit 108 determines, as a motion vector predictor, one of twomotion vector predictor candidates which has the smaller difference fromthe motion vector mvLX. The value of mvp_idx of mvpListLX [mvp_idx] isdetermined to be a value of index mvp_idx_(—)1X.

In step S250, the intra/inter prediction unit 107 performs intra/intercoding on each prediction block unit PU, based on coding controlinformation (prediction step).

EX2-1 Method for Generating Candidate List mvpListLX According toComparative Example

Next is a detailed description of a method for generating the motionvector predictor candidate list mvpListLX, with reference to FIGS. 8 to10B.

FIG. 8 is a flowchart showing a detailed processing procedure ofmvpListLX generation step S210. The coding control unit 108 initializesflags (availableLXA, isScaled, availableLXB, and the like) to 0, priorto the processing below.

First, the coding control unit 108 performs processing of generating afirst candidate for mvpListLX (S400). In step S400, the coding controlunit 108 executes processing for deriving a candidate from blocks A0 andA1 included in the block group A. It should be noted that there may be acase where a candidate cannot be derived from the block group A if intraprediction is used for both of the blocks A0 and A1, for instance.

In step S410, the coding control unit 108 searches the block group A fora block having a motion vector which is available without scalingprocessing (scaling). A detailed description thereof is given below.Search is performed in the order A0 and A1. The coding control unit 108sets flag availableLXA to 1 if search succeeds. In addition, the codingcontrol unit 108 adds a motion vector of the block obtained in thesearch to the candidate list mvpListLX.

In step S420, the coding control unit 108 determines whetheravailableLXA is 0 (whether the search has failed).

If the search fails (true in S420), the coding control unit 108 searchesthe block group A (A0, A1) for a block having an available motionvector. The search is performed in the order A0 and A1. If the searchhas succeeded, the coding control unit 108 executes scaling processingon the motion vector of the block obtained in the search, and adds themotion vector on which scaling processing has been performed to thecandidate list mvpListLx. Furthermore, the coding control unit 108 setsflag isScaled to 1. Flag isScaled is a flag indicating whether scalingprocessing has been performed on the block group A. Scaling processingis processing of increasing and decreasing the magnitude of a motionvector. It should be noted that Expressions 8-130 to 8-134 (see FIG.23(A)) in NPL 2 can be utilized for scaling processing.

Next, the coding control unit 108 performs processing of generating thesecond candidate for mvpListLX (S500). In step S500, the coding controlunit 108 executes processing for deriving a candidate from the blockgroup B (B0, B1, B2). It should be noted that a candidate may not beable to be derived from the block group B if intra prediction is usedfor all the blocks B0, B1, and B2, for instance.

Specifically, in step S510, the coding control unit 108 searches theblock group B for a block having a motion vector which is availablewithout scaling. The search is performed in the order B0, B1, and B2.The coding control unit 108 sets flag availableFlagLXB to 1 if thesearch succeeds. The coding control unit 108 adds the motion vector ofblock obtained in the search to the candidate list mvpListLX.

In step S420, the coding control unit 108 determines whetheravailableLXA==0, availableLXB==0, and furthermore isScaled==0.

If the determination result of step S420 is “true”, the coding controlunit 108 searches the block group B (B0, B1, B2) for a block having anavailable motion vector. The search is performed in the order B0, B1,and B2. If the search succeeds, the coding control unit 108 executesscaling processing on the motion vector of the block obtained in thesearch, and adds the motion vector on which scaling processing has beenperformed to the candidate list mvpListLx. It should be noted that, forexample, Expressions 8-135 to 8-139 (see FIG. 23(B)) in NPL 2 can beutilized for scaling processing.

It should be noted that it is determined in step S420 whether scalingprocessing has already been performed on the block group A(isScaled==0). This is for reducing the number of times scalingprocessing is performed. It is preferable to reduce the number of timesscaling processing is performed because scaling processing requiresgreat load. Here, the number of times scaling processing is performed isset to 1. If scaling processing is performed on the block group A, anavailable candidate has already been added to the candidate lists, andthus scaling processing is not to be performed on the block group B.

<Block Group A (A0, A1)>

First is a description of step S410 in FIG. 8 (step of searching theblock group A for a block having a motion vector which is availablewithout scaling processing), based on FIG. 9A. FIG. 9A is a flowchartshowing the detailed procedure of step S410 in FIG. 8.

In FIG. 9A, A[k] (k=0, 1) is a value indicating a block included in theblock group A. Specifically, A[0] indicates block A0, and A[1] indicatesblock A1. In FIG. 9A, processing from step S412 to step S415 is executedfor the blocks A0 and A1 (steps S411 and S416).

In step S412, the coding control unit 108 determines whether a motionvector in the prediction direction 0 of a prediction block unit PU whichincludes A[k] is a motion vector which is available without scalingprocessing.

Specifically, the coding control unit 108 determines whether aprediction block unit PU which includes A[k] satisfies all thefollowings:

(i) the prediction block unit PU is “available”,

(ii) the prediction mode thereof is not MODE_INTRA,

(iii) predFlagL0 thereof is 1, and

(iv) refIdx thereof is equal to refIdx of PU of a current block.

Here, “available” in (i) indicates that the prediction block unit PUcorresponding to A[k] can be utilized. It should be noted that “notavailable” indicates that the prediction block unit PU corresponding toA[k] cannot be utilized. Here, the case where “not available” isindicated is the case where the prediction block unit PU does not haveinformation such as a motion vector, examples of which include the casewhere the prediction block unit PU is a block located, for instance,outside the boundary of a picture or a slice, and the case where theprediction block unit PU is a block which has not been coded yet, andthe like. “MODE_INTRA” in (ii) indicates intra prediction is used. Inthe case of intra prediction, the prediction block unit PU cannot beutilized as a candidate for a motion vector predictor. “predFlagL0” in(iii) is a flag indicating whether a motion vector predictor in theprediction direction 0 is to be used, and indicates that a motion vectorpredictor in the prediction direction 0 is to be used in the case of“1”. The determination in (iv) is, in other words, a determination as towhether a reference picture of the prediction block unit PUcorresponding to A[k] is the same as a reference picture of a currentblock to be coded (decoded). This is equivalent to the determination asto whether the block has a motion vector which is available withoutperforming scaling.

If the determination result of step S412 is not true (in the case of“otherwise”), the determination in step S413 is made.

In step S413, the coding control unit 108 determines a motion vector inthe prediction direction 1 of a prediction block unit PU which includesA[k] is a motion vector which is available without scaling processing.This means that a determination made for motion data of block A[k] inthe prediction direction 0 (a motion vector and a reference index, whichalso applies in the following) is also made for motion data of A[k] inthe prediction direction 1.

If the determination result of step S412 or the determination result ofstep S413 is true, or in other words if a motion vector which isavailable without scaling processing is obtained in the search, thecoding control unit 108 sets availableFlagLXA to 1 in step S414, and instep A307, adds, to the candidate list mvpListLX, the value of mvLX ofblock A[k] as it is without performing scaling processing. After that,the processing of the coding control unit 108 proceeds to step S416.

If the determination result of step S413 is not true (if thedetermination results of steps S412 and S413 are both “otherwise”) or inother words, if a motion vector which is available without scalingprocessing is not obtained in the search, the processing of the codingcontrol unit 108 proceeds to step S416.

In step S416, if availableFlagLXA==1 or k==1, the coding control unit108 ends processing of step S410.

Next is a description of a processing procedure of step S430 (step ofperforming scaling processing on a motion vector of the block group A)in FIG. 8, based on FIG. 9B. FIG. 9B is a flowchart showing a detailedprocessing procedure of step S430 in FIG. 8. In FIG. 9B, processing ofsteps S432 to S437 is executed on the blocks A0 and A1 (steps S431 andS438).

In step S432, the coding control unit 108 determines whether a motionvector in the prediction direction 0 of the prediction block unit PUwhich includes A[k] is a motion vector on which scaling processing canbe performed.

More specifically, the coding control unit 108 makes determinations (i)to (iii) of the determinations (i) to (iv) of step S412. This processingis scaling processing, and thus the condition (iv) is not necessary.Therefore, the coding control unit 108 determines whether the predictionblock unit PU which includes A[k] is “available” (i), the predictionmode thereof is not MODE_INTRA (ii), and prefFlagL0 thereof is 1 (iii).

If the determination result of step S432 is not true (in the case of“otherwise”), the determination of step S433 is made.

In step S433, the coding control unit 108 determines whether a motionvector in the prediction direction 1 of a prediction block unit PU whichincludes A[k] is a motion vector on which scaling processing can beperformed. In step S433, the determination made on motion data in stepS432 is also performed on motion data of A[k] in the predictiondirection 1.

If the determination result of step S432 or the determination result ofstep S433 is true, or in other words, if a motion vector on whichscaling processing can be performed is obtained in the search, thecoding control unit 108 obtains information for deriving a scaling ratio(such as refIdx and List) (S434). Furthermore, the coding control unit108 sets mvLXA to the value of a motion vector mvLX of A[k], and setsrefIdxLX to the reference picture index of A[k].

In step S435, the coding control unit 108 derives a scaling ratio, andperforms scaling processing. In step S436, the coding control unit 108sets flag isScaled to 1 which indicates that scaling processing has beenperformed in the processing on the block group A. In step S437, thecoding control unit 108 sets availableFlagLXA to 1. After that, theprocessing of the coding control unit 108 proceeds to step S438.

On the other hand, if the determination result of step S433 is not true(if the determination results of steps S432 and S433 are bothotherwise), or in other words, if a motion vector on which scalingprocessing can be performed is not obtained in the search, theprocessing of the coding control unit 108 proceeds to step S438.

In step S438, if availableFlagLXA==1 or k==1, the coding control unit108 ends processing of step S430.

<Block Group B (B0, B1, B2)>

First is a description of step S510 in FIG. 8 (a step of searching theblock group B for a block having a motion vector which is availablewithout scaling processing), based on FIG. 10A. FIG. 10A is a flowchartshowing a detailed procedure of step S510 in FIG. 8.

It should be noted that processing shown in FIG. 9A and processing shownin FIG. 10A are the same except the point that blocks to be processedare different. Blocks to be processed are A0 and A1 in FIG. 9A, whereasblocks to be processed are B0, B1, and B2 in FIG. 10A. Steps S512 toS515 in FIG. 10A correspond to steps S412 to S415 in FIG. 9A,respectively.

Next is a description of a processing procedure of step S530 in FIG. 8(step of performing scaling processing on a motion vector of the blockgroup B), based on FIG. 10B. FIG. 10B is a flowchart showing a detailedprocessing procedure of step S530 in FIG. 8.

It should be noted that processing shown in FIG. 9B and processing shownin FIG. 10B are the same except the point that blocks to be processedare different, and the point that the isScaled flag is not recorded instep S436. Blocks to be processed are A0 and A1 in FIG. 9B, whereasblocks to be processed are B0, B1, and B2 in FIG. 10B. Steps S532 toS536 in FIG. 10B correspond to steps S432 to S435 and S437 in FIG. 9B,respectively.

EX2-2 Determination of Coding Control Information

FIG. 11 is a flowchart showing a detailed processing procedure of stepS240 in FIG. 3 which is a step of determining coding controlinformation. In step S240 in FIG. 3, the coding control unit 108calculates coding efficiency achieved by using each motion vectorpredictor candidate, determines a motion vector predictor candidate withwhich coding efficiency is high, as a motion vector to be used for interprediction. Accordingly, a value of mvp_idx_l0 used for inter predictionand a value of mvp_idx_l1 are determined.

Specifically, in step S301, the coding control unit 108 sets mvp_idx_l0to 0. Furthermore, the coding control unit 108 increments mvp_idx_l0 by1 after executing steps S302 to S308 described below. The coding controlunit 108 repeatedly executes steps S302 to S308.

In step S302, the coding control unit 108 determines whetheravailableFlagL0 [mvp_idx_l0] is 1.

If availableFlagL0 [mvp_idx_l0] is not 1 in step S302 (false in S302),the processing of the coding control unit 108 proceeds to step S309.

If availableFlagL0 [mvp_idx_l0] is 1 in step S302 (true in S302), theprocessing of the coding control unit 108 proceeds to step S303.

In step S303, the coding control unit 108 sets mvp_idx_l1 to 0.Furthermore, the coding control unit 108 increments mvp_idx_l1 by 1after executing steps S304 and S305 described below. The coding controlunit 108 repeatedly executes steps S304 and S305.

In step S304, the coding control unit 108 determines whetheravailableFlagL1 [mvp_idx_l1] is 1.

If availableFlagL1 [mvp_idx_l1] is not 1 in step S304 (false in S304),the processing of the coding control unit 108 proceeds to step S308.

If availableFlagL1 [mvp_idx_l1] is 1 in step S304 (true in S304), theprocessing of the coding control unit 108 proceeds to step S305.

In step S305, the coding control unit 108 performs, as a trial, intercoding using a set of motion vector predictor candidates (mvpListL0[mvp_idx_l0], mvpListL1 [mvp_idx_l1]) indicated by a set of currentmotion vector predictor indexes (mvp_idx_l0, mvp_idx_l1) (hereinafter,referred to as “a set of current motion vector predictor candidates”, asnecessary).

In step S306, the coding control unit 108 compares coding efficiencyachieved by using a set of motion vector predictor candidates indicatedby the values of a set of motion vector predictor indexes temporarilyset as mvp_idx_lx (mvpListL0 [mvp_idx_l0], mvpListL1 [mvp_idx_l1])(hereinafter, referred to as “a set of motion vector predictorcandidates temporarily set”, as necessary) with coding efficiencyachieved by using a set of current motion vector predictor candidates.

In step S306, if the coding efficiency achieved using the set of motionvector predictor candidates temporarily set is higher than the codingefficiency achieved using the set of current motion vector predictorcandidates (N in S306), the processing of the coding control unit 108proceeds to step S308.

In step S306, if the coding efficiency achieved using the set of currentmotion vector predictor candidates is higher than the coding efficiencyachieved using the set of motion vector predictor candidates temporarilyset (Y in S306), the processing of the coding control unit 108 proceedsto step S307, and the coding control unit 108 sets the set of motionvector predictor indexes mvp_idx_lx (mvp_idx_l0, mvp_idx_l1) to thevalues of the current set (mvp_idx_l0, mvp_idx_l1). It should be notedthat if no value is set in the set mvp_idx_lx of motion vector predictorindexes (mvp_idx_l0, mvp_idx_l1), the coding control unit 108 setsmvp_idx_lx to the values of the current set (mvp_idx_l0, mvp_idx_l1).

In step S308, the coding control unit 108 determines whether mvpListL1[mvp_idx_l1] is the last candidate of the candidate list (FIG. 11 shows“Processing for mvp_idx_l1 is completed?). For example, in the case ofthe candidate list mvpListL1 illustrated in FIG. 6B, the size of thecandidate list is 2, and thus it is determined that mvpListL1[mvp_idx_l1] is the last candidate if mvp_idx_l1==1 (=candidate listsize−1). If it is determined that mvpListL1 [mvp_idx_l1] is not the lastcandidate of the candidate list, the processing of the coding controlunit 108 returns to step S303, and the coding control unit 108increments mvp_idx_l1 by 1 (S303).

If it is determined in step S308 that mvpListL1 [mvp_idx_l1] is the lastcandidate of the candidate list, the processing of the coding controlunit 108 proceeds to step S309.

In step S309, the coding control unit 108 determines whether mvpListL0[mvp_idx_l0] is the last candidate of the candidate list (“Processingfor mvp_idx_l0 is completed?). For example, in the case of the candidatelist mvpListL0 illustrated in FIG. 6A, the size of the candidate list is2, and thus if mvp_idx_l0==1 (=candidate list size−1), the codingcontrol unit 108 determines that mvpListL0 [mvp_idx_l0] is the lastcandidate. If the coding control unit 108 determines that mvpListL0[mvp_idx_l0] is not the last candidate of the candidate list, theprocessing of the coding control unit 108 returns to step S301, and thecoding control unit 108 increments mvp_idx_l0 by 1 (S301).

In step S309, if the coding control unit 108 determines that mvpListL0[mvp_idx_l0] is the last candidate of the candidate list, the processingthereof proceeds to step S310.

In step S310, the coding control unit 108 determines mvp_idx_lx(mvp_idx_l0, mvp_idx_l1) as a set of motion vector predictor indexes.

The following is a brief description of the case of FIGS. 6A and 6B.

The coding control unit 108 sets mvp_idx_l0 to 0 when step S301 isexecuted in the first loop. In step S302, as illustrated in FIG. 6A, thecoding control unit 108 determines that availableFlagLXA is 1, and theprocessing thereof proceeds to step S303.

The coding control unit 108 sets mvp_idx_l1 to 0 when step S303 isexecuted in the first loop. In step S304, the processing of the codingcontrol unit 108 proceeds to step S305 since availableFlagLXB is 1 asillustrated in FIG. 6B.

In step S305, the coding control unit 108 performs, as a trial, intercoding using a current set (mvpListL0 [0], mvpListL0 [0]). In step S306,the coding control unit 108 has not executed inter coding as a trailbefore, and thus the processing thereof proceeds to step S307, and thecoding control unit 108 sets mvp_idx_lx to (0, 0).

In step S308, the processing of the coding control unit 108 proceeds tostep S309 since there is only one mvp_idx_l1 as illustrated in FIG. 6B,and thus processing is completed. In step S309 in the first loop, thecoding control unit 108 determines that processing is not completedsince mvp_idx_l0 takes two values, namely, 0 and 1 as illustrated inFIG. 6A. The processing of the coding control unit 108 returns to stepS301, and the coding control unit 108 sets mvp_idx_l0 to 1 and startsthe second loop.

When step S301 is executed in the second loop, the coding control unit108 sets mvp_idx_l0 to 1. In step S302, as illustrated in FIG. 6A, thecoding control unit 108 determines that availableFlagLXB is 1, and theprocessing thereof proceeds to step S303.

When step S303 which is the first step in the second loop is executed,the coding control unit 108 sets mvp_idx_l1 to 0. In step S304, theprocessing of the coding control unit 108 proceeds to step S305 sinceavailableFlagLXB is 1 as illustrated in FIG. 6B.

In step S305, the coding control unit 108 performs inter coding as atrial, using a current set (mvpListL0 [1], mvpListL0 [0]). In step S306,the coding control unit 108 compares coding efficiency achieved using(mvpListL0 [0], mvpListL0 [0]) which have been used to perform intercoding as a trial before with coding efficiency achieved using thecurrent set (mvpListL0 [1], mvpListL0 [0]). Here, if coding efficiencyachieved using (mvpListL0 [0], mvpListL0 [0]) used before is higher, theprocessing of the coding control unit 108 proceeds to step S308.

In step S308, the processing of the coding control unit 108 proceeds tostep S309 since there is only one mvp_idx_l1 as illustrated in FIG. 6B,and thus processing is completed. In step S309 in the second loop,mvp_idx_l0 takes two values, namely, 0 and 1 as illustrated in FIG. 6A,and processing has been executed for each, the coding control unit 108determines that processing is completed, and the processing thereofproceeds step S310.

In step S310, the coding control unit 108 determines (0, 0) to whichmvp_idx_lx is set, as a set of values of mvp_idx_lx.

EX2-3 Intra Inter Coding

FIG. 12 is a flowchart illustrating a detailed processing procedure ofstep S250 in FIG. 3. In step S250 in FIG. 3, intra/inter coding isexecuted on a moving picture indicated by an input image signal, usingcoding control information, decoding control information, and the likeobtained by the coding control unit 108.

Specifically, in step S252, the intra/inter prediction unit 107generates a predicted image of a current block to be coded, based onmotion vector mvLX, and outputs a predicted image signal indicating thegenerated predicted image. The difference unit 101 subtracts thepredicted image signal from an input image signal to generate a residualsignal. The transform unit 102 converts the residual signal from animage domain into a frequency domain, and the quantization unit 103quantizes the residual signal converted into the frequency domain togenerate a quantized residual signal. The entropy coding unit 110 codesthe quantized residual signal.

In step S254, the entropy coding unit 110 codes a set of motion vectorpredictor indexes mvp_idx_lx (mvp_idx_l0, mvp_idx_l1). The entropycoding unit 110 codes mvp_idx_lx (0, 0) in the case of FIGS. 6A and 6Bdescribed in EX2-2, for example.

In step S256, the entropy coding unit 110 codes a motion vectordifference mvdLX.

The entropy coding unit 110 generates and outputs a coded bitstreamwhich includes the quantized residual signal, the set mvp_idx_lx ofmotion vector predictor indexes (mvp_idx_l0, mvp_idx_l1), and the motionvector difference mvdLX which have been coded.

FIG. 13 illustrates a problem of mvpListLX generation processing (seeFIGS. 8 to 10B, and EX 2-1) in Comparative Example.

In FIG. 13, the horizontal double line is a symbol representing parallelprocessing, and processing between the horizontal double lines isparallel processing.

In Comparative Example above, as illustrated in FIG. 13, it is possibleto shorten a processing time period by performing processing ofobtaining a motion vector predictor candidate from the block group A(step S400 in FIG. 8) and processing of obtaining a motion vectorpredictor candidate from the block group B (step S500 in FIG. 8) inparallel.

Here, in Comparative Example above, as illustrated in FIG. 13, whetherscaling processing has been executed on the block group A in S436 instep S430 is one determination condition in step S520.

This is to prevent scaling processing from being executed on the blockgroup B if scaling processing is already executed on the block group A,in order that scaling processing which requires great processing load isto be performed once, as mentioned above.

Accordingly, in Comparative Example above, step S500 which is processingon the block group B has a problem that it is necessary to wait for thecompletion of step S400 which is processing on the block group A (inparticular, S436), in order to execute processing of step S520.

In view of this, an image decoding method according to one aspect of thepresent disclosure is a moving picture decoding method for decoding acurrent block included in a bitstream, using a motion vector predictorused when decoding a motion vector of the current block, the methodincluding: (a) obtaining one or more motion vector predictor candidateswhich are candidates for the motion vector predictor; (b) decoding acoded index for identifying one of the one or more motion vectorpredictor candidates, the coded index being added to the bitstream; and(c) selecting, based on the decoded index, the motion vector predictorto be used for decoding the current block from among the one or moremotion vector predictor candidates, wherein step (a) includes: (a1)generating a motion vector predictor candidate, based on plural motionvectors of plural first adjacent blocks adjacent to the current block ina first direction; and (a2) generating a motion vector predictorcandidate, based on plural motion vectors of plural second adjacentblocks adjacent to the current block in a second direction, and step(a2) includes: (i) determining whether the plural first adjacent blocksinclude one or more inter-predicted blocks; and (ii) searching for amotion vector to be made available by scaling processing from among theplural motion vectors of the plural second adjacent blocks when it isdetermined in step (i) that the plural first adjacent blocks do notinclude an inter-predicted block, and generating, when the motion vectoris obtained in the search, one of the one or more motion vectorpredictor candidates by executing scaling processing on the motionvector obtained in the search.

In addition, for example, in step (a2), when it is determined in step(i) that the plural first adjacent blocks include one or moreinter-predicted blocks, it may be determined whether all the one or moreof the plural first adjacent blocks determined to be inter-predictedblocks are blocks each located at a picture boundary or a sliceboundary, and step (ii) may be executed when all the one or more of theplural first adjacent blocks determined to be inter-predicted blocks areblocks each located at the picture boundary or the slice boundary.

In addition, for example, step (a2) may further include (iii) searchingfor a motion vector available without scaling processing from among theplural motion vectors of the plural second adjacent blocks, anddetermining, when a motion vector available without scaling processingis obtained in the search, the motion vector obtained in the search asone of the one or more motion vector predictor candidates, and step (i)may be executed when a motion vector available without scalingprocessing is not obtained in the search.

In addition, for example, in step (iii), it may be determined whether areference picture of the current block is the same as a referencepicture of each of the plural second adjacent blocks, and among theplural second adjacent blocks, a second adjacent block determined tohave the same reference picture may be obtained in the search as amotion vector available without scaling processing.

In addition, for example, step (a1) may include: (i) searching for amotion vector available without scaling processing from among the pluralmotion vectors of the plural first adjacent blocks, and determining,when a motion vector available without scaling processing is obtained inthe search, the motion vector obtained in the search as one of the oneor more motion vector predictor candidates; (ii) determining whether amotion vector available without scaling processing is obtained in thesearch from the plural first adjacent blocks; and (iii) searching, whenit is determined that a motion vector available without scalingprocessing is not obtained in the search from the plural first adjacentblocks, for a motion vector to be made available by scaling processingfrom among the plural motion vectors of the plural first adjacentblocks, and generating, when the motion vector is obtained in thesearch, one of the one or more motion vector predictor candidates byexecuting scaling processing on the motion vector obtained in thesearch.

In addition, for example, step (a1) and step (a2) may be executed inparallel.

An image coding method according to one aspect of the present disclosureis a moving picture coding method for coding a current block to generatea bitstream, using a motion vector predictor used when coding a motionvector of the current block, the method including: (a) obtaining one ormore motion vector predictor candidates which are candidates for themotion vector predictor; (b) selecting the motion vector predictor to beused for coding the motion vector of the current block from among theone or more motion vector predictor candidates; and (c) coding an indexfor identifying the selected motion vector predictor, and adding thecoded index to the bitstream, wherein step (a) includes: (a1) generatinga motion vector predictor candidate, based on plural motion vectors ofplural first adjacent blocks adjacent to the current block in a firstdirection; and (a2) generating a motion vector predictor candidate,based on plural motion vectors of plural second adjacent blocks adjacentto the current block in a second direction, and step (a2) includes: (i)determining whether the plural first adjacent blocks include one or moreinter-predicted blocks; and (ii) searching for a motion vector to bemade available by scaling processing from among the plural motionvectors of the plural second adjacent blocks when it is determined instep (i) that the plural first adjacent blocks do not include aninter-predicted block, and generating, when the motion vector isobtained in the search, one of the one or more motion vector predictorcandidates by executing scaling processing on the motion vector obtainedin the search.

In addition, for example, in step (a2), when it is determined in step(i) that the plural first adjacent blocks include one or moreinter-predicted blocks, it may be determined whether all the one or moreof the plural first adjacent blocks determined to be inter-predictedblocks are blocks each located at a picture boundary or a sliceboundary, and step (ii) may be executed when all the one or more of theplural first adjacent blocks determined to be inter-predicted blocks areblocks each located at the picture boundary or the slice boundary.

In addition, for example, step (a2) may further include (iii) searchingfor a motion vector available without scaling processing from among theplural motion vectors of the plural second adjacent blocks, anddetermining, when a motion vector available without scaling processingis obtained in the search, the motion vector obtained in the search asone of the one or more motion vector predictor candidates, and step (i)may be executed when a motion vector available without scalingprocessing is not obtained in the search.

In addition, for example, in step (iii), it may be determined whether areference picture of the current block is the same as a referencepicture of each of the plural second adjacent blocks, and among theplural second adjacent blocks, a second adjacent block determined tohave the same reference picture may be obtained in the search as amotion vector available without scaling processing.

In addition, for example, step (a1) may include: (i) searching for amotion vector available without scaling processing from among the pluralmotion vectors of the plural first adjacent blocks, and determining,when a motion vector available without scaling processing is obtained inthe search, the motion vector obtained in the search as one of the oneor more motion vector predictor candidates; (ii) determining whether amotion vector available without scaling processing is obtained in thesearch from the plural first adjacent blocks; and (iii) searching, whenit is determined that a motion vector available without scalingprocessing is not obtained in the search from the plural first adjacentblocks, for a motion vector to be made available by scaling processingfrom among the plural motion vectors of the plural first adjacentblocks, and generating, when the motion vector is obtained in thesearch, one of the one or more motion vector predictor candidates byexecuting scaling processing on the motion vector obtained in thesearch.

In addition, for example, step (a1) and step (a2) may be executed inparallel.

An image decoding apparatus according to one aspect of the presentdisclosure is a moving picture decoding apparatus which decodes acurrent block included in a bitstream, using a motion vector predictorused when decoding a motion vector of the current block, the apparatusincluding: a motion vector predictor candidate obtaining unit configuredto obtain one or more motion vector predictor candidates which arecandidates for the motion vector predictor; a decoding unit configuredto decode a coded index for identifying one of the one or more motionvector predictor candidates, the coded index being added to thebitstream; and a selection unit configured to select, based on thedecoded index, the motion vector predictor to be used for decoding thecurrent block from among the one or more motion vector predictorcandidates, wherein the motion vector predictor candidate obtaining unitis configured to execute: first candidate generation processing ofgenerating a motion vector predictor candidate, based on plural motionvectors of plural first adjacent blocks adjacent to the current block ina first direction; and second candidate generation processing ofgenerating a motion vector predictor candidate, based on plural motionvectors of plural second adjacent blocks adjacent to the current blockin a second direction, and in the second candidate generationprocessing, the motion vector predictor candidate obtaining unit isconfigured to: determine whether the plural first adjacent blocksinclude one or more inter-predicted blocks; and search for a motionvector to be made available by scaling processing from among the pluralmotion vectors of the plural second adjacent blocks when the motionvector predictor candidate obtaining unit determines that the pluralfirst adjacent blocks do not include an inter-predicted block, andgenerate, when the motion vector predictor candidate obtaining unitobtains the motion vector in the search, one of the one or more motionvector predictor candidates by executing scaling processing on themotion vector obtained in the search.

An image coding apparatus according to one aspect of the presentdisclosure is a moving picture coding apparatus which codes a currentblock to generate a bitstream, using a motion vector predictor used whencoding a motion vector of the current block, the apparatus including: amotion vector predictor candidate obtaining unit configured to obtainone or more motion vector predictor candidates which are candidates forthe motion vector predictor; a selection unit configured to select themotion vector predictor to be used for coding the motion vector of thecurrent block from among the one or more motion vector predictorcandidates; and a coding unit configured to code an index foridentifying the selected motion vector predictor, and add the codedindex to the bitstream, wherein the motion vector predictor candidateobtaining unit is configured to execute: first candidate generationprocessing of generating a motion vector predictor candidate, based onplural motion vectors of plural first adjacent blocks adjacent to thecurrent block in a first direction; and second candidate generationprocessing of generating a motion vector predictor candidate, based onplural motion vectors of plural second adjacent blocks adjacent to thecurrent block in a second direction, and in the second candidategeneration processing, the motion vector predictor candidate obtainingunit is configured to: determine whether the plural first adjacentblocks include one or more inter-predicted blocks; and search for amotion vector to be made available by scaling processing from among theplural motion vectors of the plural second adjacent blocks when themotion vector predictor candidate obtaining unit determines that theplural first adjacent blocks do not include an inter-predicted block,and generate, when the motion vector predictor candidate obtaining unitobtains the motion vector in the search, one of the one or more motionvector predictor candidates by executing scaling processing on themotion vector obtained in the search.

An image coding and decoding apparatus according to one aspect of thepresent disclosure includes the above moving picture decoding apparatusand the above moving picture coding apparatus.

It should be noted that these general and specific aspects may beimplemented using a system, a method, an integrated circuit, a computerprogram, a computer-readable recording medium such as a CD-ROM, or anycombination of systems, methods, integrated circuits, computer programsor recording media.

The following is a specific description of a moving picture codingapparatus and a moving picture decoding apparatus according to an aspectof the present disclosure, with reference to the drawings.

Each of the exemplary embodiments described below shows a specificexample of the present disclosure. Numerical values, shapes, material,constituent elements, the arranged positions and connectionconfiguration of the constituent elements, steps, the order of thesteps, and so on described in the following embodiments are mereexamples. Therefore, among the constituent elements in the followingexemplary embodiments, constituent elements not recited in any one ofthe independent claims are described as arbitrary constituent elements.

Embodiment 1

A description is given of a moving picture coding apparatus and a movingpicture coding method according to the present embodiment, based on FIG.14.

It should be noted that the configuration of the moving picture codingapparatus according to the present embodiment is the same as theconfiguration of the moving picture coding apparatus 100 according toComparative Example illustrated in FIG. 2.

In addition, the present embodiment describes the case using an examplein which the relationship between a coding block unit CU and aprediction block unit PU is the same as the relationship between thecoding block unit CU and the prediction block unit PU in ComparativeExample illustrated in FIG. 4A, to facilitate description.

[1-1: Moving Picture Coding Method According to Embodiment 1]

A description is given of processing operation (moving picture codingmethod) of the moving picture coding apparatus 100 according to thepresent embodiment, based on FIG. 14. FIG. 6 illustrates a processingprocedure of the moving picture coding apparatus 100 according to thepresent embodiment.

It should be noted that in FIG. 14, processing of steps S410 and S430 ona block group A, and steps S510 and S530 on a block group B are the sameas processing in Comparative Example above (see FIGS. 8 to 10B).

It should be noted that in the present embodiment, a predicted image isgenerated per prediction block unit PU, as with Comparative Example. Inaddition, the present embodiment describes the case as an example inwhich the size of prediction block unit PU is smaller than that of thecoding block unit CU as with Comparative Example. In addition, therelationship between the coding block unit CU and the prediction blockunit PU in the present embodiment is the same as the relationshipbetween the coding block unit CU and the prediction block unit PU inComparative Example illustrated in FIGS. 4A to 4C.

In the moving picture coding method according to the present embodimentillustrated in FIG. 14, determination processing of step S620 isexecuted, instead of determination processing of step S520, in contrastto Comparative Example illustrated in FIG. 13.

Specifically, as illustrated in FIG. 14, in step S400, a coding controlunit 108 executes processing of searching the block group A for a motionvector which is available without scaling processing (S410), andexecutes scaling processing (S430) on a block included in the blockgroup A if a motion vector which is available without scaling processingis not obtained in the search (true in S420).

Furthermore, the coding control unit 108 executes step S600 in parallelwith step S400 described above, as illustrated in FIG. 14. In step S600,first, the coding control unit 108 executes processing of searching theblock group B for a motion vector which is available without scalingprocessing (S510).

In step S620, the coding control unit 108 determines (1) whetheravailableFlavLXB==0 (not shown in FIG. 14), and (2) whether “any blockin the block group A (A0, A1) is an INTER block”. In other words, instep S620, when (1) availableFlavLXB==0, and furthermore a block whoseprediction mode is MODE_INTER is included in the block group A, theresult is determined to be true.

If (1) availableFlavLXB==0, and furthermore the prediction mode of A0(block on the bottom left of FIG. 5) or A1 (block on the left of FIG. 5)is MODE_INTER as a result of the determination (true in S620), thecoding control unit 108 ends step S600 without executing processing ofS530 (scaling processing on the block group B).

This is based on an assumption that “if the prediction mode of any blockin the block group A adjacent on the left of a current block to bepredicted is MODE_INTER, a possibility that scaling processing is usedis high”, and thus scaling processing is not to be performed on theblock group B if the prediction mode of any block in the block group Ais MODE_INTER.

In this way, the processing result of step S400 is not used in stepS620. In other words, steps S400 and S600 do not depend on each other.Accordingly, the moving picture coding apparatus 100 can execute inparallel step S400 which is processing on the block group A and stepS600 which is processing on the block group B, and increase theprocessing speed without increasing processing load (without increasingthe number of times scaling processing is performed).

Embodiment 2

A description is given of a moving picture decoding apparatus and amoving picture decoding method according to the present embodiment,based on FIG. 15. The moving picture decoding apparatus according to thepresent embodiment accepts a coded bitstream from the moving picturecoding apparatus 100 according to Embodiment 1, generates decoded imagesignals by decoding a coded bitstream, and outputs the signals in thedisplay order.

[2-1: Configuration of Moving Picture Decoding Apparatus According toEmbodiment 2]

A description is given of a configuration of a moving picture decodingapparatus 300 according to the present embodiment, based on FIG. 15.FIG. 15 is a block diagram illustrating the configuration of the movingpicture decoding apparatus 300.

As illustrated in FIG. 15, the moving picture decoding apparatus 300includes an entropy decoding unit 301, an inverse quantization unit 302,an inverse transform unit 303, an addition unit 304, an intra/interprediction unit 305, a decoding control unit 306, and a memory 307.

The entropy decoding unit 301 performs variable-length decodingprocessing on an inputted coded bitstream, and thereby generates aquantized residual signal (quantization coefficient), picture typeinformation, a prediction direction flag, and a motion vector differencemvdLX. The entropy decoding unit 301 performs variable-length decodingprocessing on a motion vector predictor index. Furthermore, the entropydecoding unit 301 outputs decoding control information to the decodingcontrol unit 306 described below. Here, decoding control informationincludes a motion vector predictor index mvp_idx_lx (mvp_idx_l0,mvp_idx_l1) and a motion vector difference mvdLX (mvdL0, mvdL1).

The inverse quantization unit 302 performs inverse quantizationprocessing on a quantization coefficient (quantized residual signal)obtained by variable-length decoding processing. The inverse transformunit 303 outputs a reconstructed residual signal (prediction error data)by converting a transform coefficient obtained by inverse quantizationprocessing from a frequency domain into an image domain.

In the memory 307, decoded image data indicated by decoded image signalsoutputted from the addition unit 304 described below is stored on ablock-by-block basis and a frame-by-frame basis.

The intra/inter prediction unit 305 performs inter-prediction usingdecoded image data in a frame unit stored in the memory 307 or usingdecoded image data in a block unit, thereby generating a predicted imagesignal of a current block to be decoded.

The decoding control unit 306 derives motion vector predictor candidatelists mvpListL0 and mvpListL1, and selects, from the derived motionvector predictor candidate lists, a motion vector predictor mvLX to beused for inter prediction, based on the motion vector predictor index(mvp_idx_l0, mvp_idx_l1). Furthermore, the decoding control unit 306calculates the motion vector mvLX of a current block to be decoded,using the motion vector predictor mvpLX and the motion vector differencemvdLX (mvdL0, mvdL1). Then, if the prediction mode of a current block tobe predicted is MODE_INTER, the decoding control unit 306 causes theintra/inter prediction unit 305 to generate an inter-predicted imageusing the calculated motion vector mvLX.

Finally, the addition unit 304 generates a decoded image signal byadding a reconstructed residual signal and a predicted image signal.

[2-2: Moving Picture Decoding Method According to in Embodiment 2]

A description is given of the processing operation (moving picturedecoding method) of the moving picture decoding apparatus 300 accordingto the present embodiment, based on FIG. 16. FIG. 16 is a flowchartshowing a processing procedure of the moving picture decoding methodaccording to the present embodiment.

It should be noted that in the present embodiment, a predicted image isgenerated per prediction block PU, as with Embodiment 1. The presentembodiment describes the case as an example in which the size of aprediction block unit PU is smaller than that of a coding block unit CU,as with Embodiment 1. In addition, the relationship between a codingblock unit CU and a prediction block unit PU in the present embodimentis the same as that in Comparative Example illustrated in FIG. 4A.

The following is a description of the case where a current block to bedecoded is CU12, as an example. As illustrated in FIGS. 4B and 4C, theprediction mode of the current block CU12 is MODE_INTER, and the currentblock CU12 includes two prediction block units PU, namely, PU0 and PU1(N×2N). It should be noted that as described in Comparative Example, inFIG. 4B, the area enclosed by the one-point dashed line is an areahaving information which is already “available” at the point in timewhen coding the prediction block unit PU0 of the current block CU12. Asillustrated in FIG. 4B, in Comparative Example, coding block units CU2and CU3 are not “available” when coding the current block CU12.

Referring to FIG. 16, in step S1010, the decoding control unit 306performs processing of generating a candidate list mvpListX of motionvector predictors. This processing corresponds to the mvpListXgeneration processing of step S210 illustrated in FIG. 3 performed bythe moving picture coding apparatus 100 according to Embodiment 1(Comparative Example 1). More specifically, the decoding control unit306 performs the same processing as the processing illustrated in FIG.14 executed by the moving picture coding apparatus 100, which will bedescribed in detailed below.

In step S1020, the decoding control unit 306 performs update processingon mvpListLX (update step). This processing corresponds to the updateprocessing of step S230 illustrated in FIG. 3 performed by the movingpicture coding apparatus 100 according to Embodiment 1 (ComparativeExample 1).

In step S1030, the entropy decoding unit 301 extracts a motion vectorpredictor index mvp_idx_lx from a coded bitstream.

In step S1040, the entropy decoding unit 301 extracts a motion vectordifference mvdLX from the coded bitstream.

In step S1050, the decoding control unit 306 reconstructs a motionvector in the prediction direction X. Specifically, the decoding controlunit 306 identifies a motion vector predictor mvpListX [mvp_idx_lx] fromthe candidate list mvpListX of motion vector predictors generated instep S1020, using the motion vector predictor index mvp_idx_lx extractedby the entropy decoding unit 301. As indicated by Expression 1, thedecoding control unit 306 adds the motion vector difference mvdLX andthe motion vector predictor mvpListX [mvp_idx_lx], thereby obtaining themotion vector mvLX.mvLX=mvpListLX[mvp _(—) idx _(—) lx]+mvdLX  (Expression 1)

In step S1060, the moving picture decoding apparatus 300 generates apredicted image signal using the motion vector mvLX reconstructed by theintra/inter prediction unit 305, and generates a decoded image signal bythe addition unit 304 adding a reconstructed residual signal and apredicted image signal.

FIG. 17 is a flowchart illustrating a detailed processing procedure ofthe mvpListLX creation step which is step S1010 in FIG. 16.

In step S400, the decoding control unit 306 creates an entry from ablock group A (A0, A1). Specifically, in step S401, the decoding controlunit 306 searches the block group A (A0, A1) for a motion vector whichis available without scaling processing. If a motion vector which isavailable without scaling processing is not obtained in the search (truein S420), the decoding control unit 306 searches for an available motionvector, and performs scaling processing on the motion vector obtained inthe search (S430). It should be noted that processing of step S400 isthe same processing as step S400 performed by the coding control unit108 of the moving picture coding apparatus 100.

In step S800, the decoding control unit 306 creates an entry from theblock group B (B0, B1, B2).

Specifically, in step S510, the decoding control unit 306 searches theblock group B (B0, B1, B2) for a motion vector which is availablewithout scaling processing. Processing of step S510 is the sameprocessing as step S510 performed by the coding control unit 108 of themoving picture coding apparatus 100.

In step S820, the decoding control unit 306 determines whetheravailableFlavLXB==0, and furthermore the prediction mode of any block inthe block group A is MODE_INTER. More specifically, if the decodingcontrol unit 306 executes steps S400 and S800 in parallel(sequentially), the decoding control unit 306 determines in step S510whether availableFlag is not set (availableFlagLXB is still set to 0)and furthermore whether “the prediction mode of any of blocks A0, A1,and so on in the block group A is MODE_INTER” returns true, which is adetermination condition used instead of the is Scaled determination.

If availableFlavLXB==0, and furthermore the prediction mode of any oneblock in the block group A is MODE_INTER (true in S820), the decodingcontrol unit 306 ends the mvpListLX creation step without performingscaling processing.

If availableFlavLXB==0, and furthermore the prediction mode of none ofthe blocks in the block group A is MODE_INTER (false in S820), thedecoding control unit 306 searches for an available motion vector, andperforms scaling processing on the motion vector obtained in the search(S530). The processing of step S530 is the same as processing of stepS530 performed by the coding control unit 108 of the moving picturecoding apparatus 100.

FIG. 18 sequentially illustrates the mvpListLX creation step which isstep S1010. It should be noted that the steps in FIG. 18 (S410, S420,S430, S510, S820, S530) are the same as the steps in FIG. 17 (S410,S420, S430, S510, S820, S530).

As is clear from FIG. 18, in the moving picture decoding apparatus 300according to the present embodiment, what is determined in step S820performed in the processing on the block group B does not depend on theresult of processing of step S1010 on the block group A. Thus, it ispossible to execute the following steps in parallel:

S400: generation of an entry based on the block group A (A0, A1); and

S800: generation of an entry based on the block group B (A0, A1).

Example 1 of Determination Common Points of Moving Picture CodingApparatus 100 and Moving Picture Decoding Apparatus 300

FIG. 19 illustrates the determination results of step S620 in FIG. 14and step S820 in FIG. 18 obtained when a current block to be predicted(a current block to be coded, a current block to be decoded) is PU0 (seeFIG. 4A). As described above, it is determined in step S620 in FIG. 14and step S820 in FIG. 18 whether any of the blocks A0 and A1 in theblock group A is an INTER block.

In the case of FIG. 19, an adjacent block A0 is not available, and theprediction mode thereof is not MODE_INTER. In addition, although anadjacent block A1 is available, the prediction mode thereof isMODE_INTRA and not MODE_INTER.

Therefore, in the above determination step, the result is determined tobe false since the prediction mode of both the adjacent blocks A0 and A0is not MODE_INTER in the case of FIG. 19.

Example 2 of Determination Common Points of Moving Picture CodingApparatus 100 and Moving Picture Decoding Apparatus 300

FIG. 20 illustrates the determination results of step S620 in FIG. 14and step S820 in FIG. 18 obtained when a current block to be predictedis PU1.

In the case of FIG. 20, in regard with the adjacent block A0, CU3 isstill not available. In addition, the prediction mode of the adjacentblock A1 is MODE_INTER.

Therefore, in the above determination step, the result is determined tobe true since the prediction mode of the adjacent block A1 is MODE_INTERin the case of FIG. 20.

(Effects and Others)

According to the moving picture coding method and the coding apparatusaccording to Embodiment 1 and the moving picture decoding method and themoving picture decoding apparatus according to Embodiment 2, whengenerating mvpListLX (step S620 in FIG. 14, step S820 in FIG. 18), thedetermination as to whether scaling calculation has been performed onthe block group A can be omitted in the determination as to whetherscaling processing is to be performed on the block group B. In otherwords, the coding control unit 108 and the decoding control unit 306 candetermine whether to perform scaling processing on the block group B,without using the result of processing on the block group A.

In addition, before creating the candidate list mvpListLX, if adetermination is just made as to whether the block group A includes anINTER block, motion vector predictor candidates can be calculated fromthe block groups A and B in parallel (FIGS. 14 and 18).

It should be noted that although it is determined in steps S620 and S820whether the prediction mode of any one of blocks A0 and A1 in the blockgroup A is MODE_INTER, the embodiments are not limited to this. In stepsS620 and S820, for example, a determination may be made as to whethernone of the followings are satisfied: (1) the prediction mode of a blockis MODE_INTRA, (2) a block is at a slice or picture boundary, and (3) ablock is an unprocessed block (uncoded block or undecoded block).

In addition, in Embodiments 1 and 2, although steps S620 and S820 areexecuted after step S510, the embodiments are not limited to this. StepsS620 and S820 may be executed, as step S840, before executing theprocessing in parallel, or specifically, before executing steps S410 andS510, as illustrated in FIG. 21, for example. It should be noted thatthe order of determination (order of an AND operation and an ORoperation) is not limited to Embodiments 1 and 2 above and the order oflogical operation according to which the result of determination isequal is included in the present disclosure.

As described above, according to the moving picture coding methodaccording to Embodiment 1 and the moving picture decoding methodaccording to Embodiment 2, in steps S620 and S820, processing on theblock group B can be executed without using the result of processing onthe block group A, and processing on the block group A and processing onthe block group B can be performed in parallel.

Embodiment 3

FIG. 23 is a flowchart illustrating another embodiment of the movingpicture coding method according to Embodiment 1 and the moving picturedecoding method according to Embodiment 2.

Although in Embodiments 1 and 2, it is determined whether scalingprocessing is to be allowed in the processing on the block group B,based on the result of determination as to whether any of the blocks(A0, A1) in the block group A is an INTER block, scaling processing onthe block group B is completely inhibited in the present embodiment.

In this way, it is also possible to resolve dependency by not performingsteps S620, S820, and S530.

Embodiment 4

The processing described in each of embodiments can be simplyimplemented in an independent computer system, by recording, in arecording medium, a program for implementing the configurations of themoving picture coding method (image coding method) and the movingpicture decoding method (image decoding method) described in each ofembodiments. The recording media may be any recording media as long asthe program can be recorded, such as a magnetic disk, an optical disk, amagnetic optical disk, an IC card, and a semiconductor memory.

Hereinafter, the applications to the moving picture coding method (imagecoding method) and the moving picture decoding method (image decodingmethod) described in each of embodiments and systems using thereof willbe described. The system has a feature of having an image coding anddecoding apparatus that includes an image coding apparatus using theimage coding method and an image decoding apparatus using the imagedecoding method. Other configurations in the system can be changed asappropriate depending on the cases.

FIG. 24 illustrates an overall configuration of a content providingsystem ex100 for implementing content distribution services. The areafor providing communication services is divided into cells of desiredsize, and base stations ex106, ex107, ex108, ex109, and ex110 which arefixed wireless stations are placed in each of the cells.

The content providing system ex100 is connected to devices, such as acomputer ex111, a personal digital assistant (PDA) ex112, a cameraex113, a cellular phone ex114 and a game machine ex115, via the Internetex101, an Internet service provider ex102, a telephone network ex104, aswell as the base stations ex106 to ex110, respectively.

However, the configuration of the content providing system ex100 is notlimited to the configuration shown in FIG. 24, and a combination inwhich any of the elements are connected is acceptable. In addition, eachdevice may be directly connected to the telephone network ex104, ratherthan via the base stations ex106 to ex110 which are the fixed wirelessstations. Furthermore, the devices may be interconnected to each othervia a short distance wireless communication and others.

The camera ex113, such as a digital video camera, is capable ofcapturing video. A camera ex116, such as a digital camera, is capable ofcapturing both still images and video. Furthermore, the cellular phoneex114 may be the one that meets any of the standards such as GlobalSystem for Mobile Communications (GSM) (registered trademark), CodeDivision Multiple Access (CDMA), Wideband-Code Division Multiple Access(W-CDMA), Long Term Evolution (LTE), and High Speed Packet Access(HSPA). Alternatively, the cellular phone ex114 may be a PersonalHandyphone System (PHS).

In the content providing system ex100, a streaming server ex103 isconnected to the camera ex113 and others via the telephone network ex104and the base station ex109, which enables distribution of images of alive show and others. In such a distribution, a content (for example,video of a music live show) captured by the user using the camera ex113is coded as described above in each of embodiments (i.e., the camerafunctions as the image coding apparatus according to an aspect of thepresent disclosure), and the coded content is transmitted to thestreaming server ex103. On the other hand, the streaming server ex103carries out stream distribution of the transmitted content data to theclients upon their requests. The clients include the computer ex111, thePDA ex112, the camera ex113, the cellular phone ex114, and the gamemachine ex115 that are capable of decoding the above-mentioned codeddata. Each of the devices that have received the distributed datadecodes and reproduces the coded data (i.e., functions as the imagedecoding apparatus according to an aspect of the present disclosure).

The captured data may be coded by the camera ex113 or the streamingserver ex103 that transmits the data, or the coding processes may beshared between the camera ex113 and the streaming server ex103.Similarly, the distributed data may be decoded by the clients or thestreaming server ex103, or the decoding processes may be shared betweenthe clients and the streaming server ex103. Furthermore, the data of thestill images and video captured by not only the camera ex113 but alsothe camera ex116 may be transmitted to the streaming server ex103through the computer ex111. The coding processes may be performed by thecamera ex116, the computer ex111, or the streaming server ex103, orshared among them.

Furthermore, the coding and decoding processes may be performed by anLSI ex500 generally included in each of the computer ex111 and thedevices. The LSI ex500 may be configured of a single chip or a pluralityof chips. Software for coding and decoding video may be integrated intosome type of a recording medium (such as a CD-ROM, a flexible disk, anda hard disk) that is readable by the computer ex111 and others, and thecoding and decoding processes may be performed using the software.Furthermore, when the cellular phone ex114 is equipped with a camera,the video data obtained by the camera may be transmitted. The video datais data coded by the LSI ex500 included in the cellular phone ex114.

Furthermore, the streaming server ex103 may be composed of servers andcomputers, and may decentralize data and process the decentralized data,record, or distribute data.

As described above, the clients may receive and reproduce the coded datain the content providing system ex100. In other words, the clients canreceive and decode information transmitted by the user, and reproducethe decoded data in real time in the content providing system ex100, sothat the user who does not have any particular right and equipment canimplement personal broadcasting.

Aside from the example of the content providing system ex100, at leastone of the moving picture coding apparatus (image coding apparatus) andthe moving picture decoding apparatus (image decoding apparatus)described in each of embodiments may be implemented in a digitalbroadcasting system ex200 illustrated in FIG. 25. More specifically, abroadcast station ex201 communicates or transmits, via radio waves to abroadcast satellite ex202, multiplexed data obtained by multiplexingaudio data and others onto video data. The video data is data coded bythe moving picture coding method described in each of embodiments (i.e.,data coded by the image coding apparatus according to an aspect of thepresent disclosure). Upon receipt of the multiplexed data, the broadcastsatellite ex202 transmits radio waves for broadcasting. Then, a home-useantenna ex204 with a satellite broadcast reception function receives theradio waves. Next, a device such as a television (receiver) ex300 and aset top box (STB) ex217 decodes the received multiplexed data, andreproduces the decoded data (i.e., functions as the image decodingapparatus according to an aspect of the present disclosure).

Furthermore, a reader/recorder ex218 (i) reads and decodes themultiplexed data recorded on a recording medium ex215, such as a DVD anda BD, or (i) codes video signals in the recording medium ex215, and insome cases, writes data obtained by multiplexing an audio signal on thecoded data. The reader/recorder ex218 can include the moving picturedecoding apparatus or the moving picture coding apparatus as shown ineach of embodiments. In this case, the reproduced video signals aredisplayed on the monitor ex219, and can be reproduced by another deviceor system using the recording medium ex215 on which the multiplexed datais recorded. It is also possible to implement the moving picturedecoding apparatus in the set top box ex217 connected to the cable ex203for a cable television or to the antenna ex204 for satellite and/orterrestrial broadcasting, so as to display the video signals on themonitor ex219 of the television ex300. The moving picture decodingapparatus may be implemented not in the set top box but in thetelevision ex300.

FIG. 26 illustrates the television (receiver) ex300 that uses the movingpicture coding method and the moving picture decoding method describedin each of embodiments. The television ex300 includes: a tuner ex301that obtains or provides multiplexed data obtained by multiplexing audiodata onto video data, through the antenna ex204 or the cable ex203, etc.that receives a broadcast; a modulation/demodulation unit ex302 thatdemodulates the received multiplexed data or modulates data intomultiplexed data to be supplied outside; and amultiplexing/demultiplexing unit ex303 that demultiplexes the modulatedmultiplexed data into video data and audio data, or multiplexes videodata and audio data coded by a signal processing unit ex306 into data.

The television ex300 further includes: a signal processing unit ex306including an audio signal processing unit ex304 and a video signalprocessing unit ex305 that decode audio data and video data and codeaudio data and video data, respectively (which function as the imagecoding apparatus and the image decoding apparatus according to theaspects of the present disclosure); and an output unit ex309 including aspeaker ex307 that provides the decoded audio signal, and a display unitex308 that displays the decoded video signal, such as a display.Furthermore, the television ex300 includes an interface unit ex317including an operation input unit ex312 that receives an input of a useroperation. Furthermore, the television ex300 includes a control unitex310 that controls overall each constituent element of the televisionex300, and a power supply circuit unit ex311 that supplies power to eachof the elements. Other than the operation input unit ex312, theinterface unit ex317 may include: a bridge ex313 that is connected to anexternal device, such as the reader/recorder ex218; a slot unit ex314for enabling attachment of the recording medium ex216, such as an SDcard; a driver ex315 to be connected to an external recording medium,such as a hard disk; and a modem ex316 to be connected to a telephonenetwork. Here, the recording medium ex216 can electrically recordinformation using a non-volatile/volatile semiconductor memory elementfor storage. The constituent elements of the television ex300 areconnected to each other through a synchronous bus.

First, the configuration in which the television ex300 decodesmultiplexed data obtained from outside through the antenna ex204 andothers and reproduces the decoded data will be described. In thetelevision ex300, upon a user operation through a remote controllerex220 and others, the multiplexing/demultiplexing unit ex303demultiplexes the multiplexed data demodulated by themodulation/demodulation unit ex302, under control of the control unitex310 including a CPU. Furthermore, the audio signal processing unitex304 decodes the demultiplexed audio data, and the video signalprocessing unit ex305 decodes the demultiplexed video data, using thedecoding method described in each of embodiments, in the televisionex300. The output unit ex309 provides the decoded video signal and audiosignal outside, respectively. When the output unit ex309 provides thevideo signal and the audio signal, the signals may be temporarily storedin buffers ex318 and ex319, and others so that the signals arereproduced in synchronization with each other. Furthermore, thetelevision ex300 may read multiplexed data not through a broadcast andothers but from the recording media ex215 and ex216, such as a magneticdisk, an optical disk, and a SD card. Next, a configuration in which thetelevision ex300 codes an audio signal and a video signal, and transmitsthe data outside or writes the data on a recording medium will bedescribed. In the television ex300, upon a user operation through theremote controller ex220 and others, the audio signal processing unitex304 codes an audio signal, and the video signal processing unit ex305codes a video signal, under control of the control unit ex310 using thecoding method described in each of embodiments. Themultiplexing/demultiplexing unit ex303 multiplexes the coded videosignal and audio signal, and provides the resulting signal outside. Whenthe multiplexing/demultiplexing unit ex303 multiplexes the video signaland the audio signal, the signals may be temporarily stored in thebuffers ex320 and ex321, and others so that the signals are reproducedin synchronization with each other. Here, the buffers ex318, ex319,ex320, and ex321 may be plural as illustrated, or at least one buffermay be shared in the television ex300. Furthermore, data may be storedin a buffer so that the system overflow and underflow may be avoidedbetween the modulation/demodulation unit ex302 and themultiplexing/demultiplexing unit ex303, for example.

Furthermore, the television ex300 may include a configuration forreceiving an AV input from a microphone or a camera other than theconfiguration for obtaining audio and video data from a broadcast or arecording medium, and may code the obtained data. Although thetelevision ex300 can code, multiplex, and provide outside data in thedescription, it may be capable of only receiving, decoding, andproviding outside data but not the coding, multiplexing, and providingoutside data.

Furthermore, when the reader/recorder ex218 reads or writes multiplexeddata from or on a recording medium, one of the television ex300 and thereader/recorder ex218 may decode or code the multiplexed data, and thetelevision ex300 and the reader/recorder ex218 may share the decoding orcoding.

As an example, FIG. 27 illustrates a configuration of an informationreproducing/recording unit ex400 when data is read or written from or onan optical disk. The information reproducing/recording unit ex400includes constituent elements ex401, ex402, ex403, ex404, ex405, ex406,and ex407 to be described hereinafter. The optical head ex401 irradiatesa laser spot in a recording surface of the recording medium ex215 thatis an optical disk to write information, and detects reflected lightfrom the recording surface of the recording medium ex215 to read theinformation. The modulation recording unit ex402 electrically drives asemiconductor laser included in the optical head ex401, and modulatesthe laser light according to recorded data. The reproductiondemodulating unit ex403 amplifies a reproduction signal obtained byelectrically detecting the reflected light from the recording surfaceusing a photo detector included in the optical head ex401, anddemodulates the reproduction signal by separating a signal componentrecorded on the recording medium ex215 to reproduce the necessaryinformation. The buffer ex404 temporarily holds the information to berecorded on the recording medium ex215 and the information reproducedfrom the recording medium ex215. The disk motor ex405 rotates therecording medium ex215. The servo control unit ex406 moves the opticalhead ex401 to a predetermined information track while controlling therotation drive of the disk motor ex405 so as to follow the laser spot.The system control unit ex407 controls overall the informationreproducing/recording unit ex400. The reading and writing processes canbe implemented by the system control unit ex407 using variousinformation stored in the buffer ex404 and generating and adding newinformation as necessary, and by the modulation recording unit ex402,the reproduction demodulating unit ex403, and the servo control unitex406 that record and reproduce information through the optical headex401 while being operated in a coordinated manner. The system controlunit ex407 includes, for example, a microprocessor, and executesprocessing by causing a computer to execute a program for read andwrite.

Although the optical head ex401 irradiates a laser spot in thedescription, it may perform high-density recording using near fieldlight.

FIG. 28 illustrates the recording medium ex215 that is the optical disk.On the recording surface of the recording medium ex215, guide groovesare spirally formed, and an information track ex230 records, in advance,address information indicating an absolute position on the diskaccording to change in a shape of the guide grooves. The addressinformation includes information for determining positions of recordingblocks ex231 that are a unit for recording data. Reproducing theinformation track ex230 and reading the address information in anapparatus that records and reproduces data can lead to determination ofthe positions of the recording blocks. Furthermore, the recording mediumex215 includes a data recording area ex233, an inner circumference areaex232, and an outer circumference area ex234. The data recording areaex233 is an area for use in recording the user data. The innercircumference area ex232 and the outer circumference area ex234 that areinside and outside of the data recording area ex233, respectively arefor specific use except for recording the user data. The informationreproducing/recording unit 400 reads and writes coded audio, coded videodata, or multiplexed data obtained by multiplexing the coded audio andvideo data, from and on the data recording area ex233 of the recordingmedium ex215.

Although an optical disk having a layer, such as a DVD and a BD isdescribed as an example in the description, the optical disk is notlimited to such, and may be an optical disk having a multilayerstructure and capable of being recorded on a part other than thesurface. Furthermore, the optical disk may have a structure formultidimensional recording/reproduction, such as recording ofinformation using light of colors with different wavelengths in the sameportion of the optical disk and for recording information havingdifferent layers from various angles.

Furthermore, a car ex210 having an antenna ex205 can receive data fromthe satellite ex202 and others, and reproduce video on a display devicesuch as a car navigation system ex211 set in the car ex210, in thedigital broadcasting system ex200. Here, a configuration of the carnavigation system ex211 will be a configuration, for example, includinga GPS receiving unit from the configuration illustrated in FIG. 26. Thesame will be true for the configuration of the computer ex111, thecellular phone ex114, and others.

FIG. 29A illustrates the cellular phone ex114 that uses the movingpicture coding method and the moving picture decoding method describedin embodiments. The cellular phone ex114 includes: an antenna ex350 fortransmitting and receiving radio waves through the base station ex110; acamera unit ex365 capable of capturing moving and still images; and adisplay unit ex358 such as a liquid crystal display for displaying thedata such as decoded video captured by the camera unit ex365 or receivedby the antenna ex350. The cellular phone ex114 further includes: a mainbody unit including an operation key unit ex366; an audio output unitex357 such as a speaker for output of audio; an audio input unit ex356such as a microphone for input of audio; a memory unit ex367 for storingcaptured video or still pictures, recorded audio, coded or decoded dataof the received video, the still pictures, e-mails, or others; and aslot unit ex364 that is an interface unit for a recording medium thatstores data in the same manner as the memory unit ex367.

Next, an example of a configuration of the cellular phone ex114 will bedescribed with reference to FIG. 29B. In the cellular phone ex114, amain control unit ex360 designed to control overall each unit of themain body including the display unit ex358 as well as the operation keyunit ex366 is connected mutually, via a synchronous bus ex370, to apower supply circuit unit ex361, an operation input control unit ex362,a video signal processing unit ex355, a camera interface unit ex363, aliquid crystal display (LCD) control unit ex359, amodulation/demodulation unit ex352, a multiplexing/demultiplexing unitex353, an audio signal processing unit ex354, the slot unit ex364, andthe memory unit ex367.

When a call-end key or a power key is turned ON by a user's operation,the power supply circuit unit ex361 supplies the respective units withpower from a battery pack so as to activate the cell phone ex114.

In the cellular phone ex114, the audio signal processing unit ex354converts the audio signals collected by the audio input unit ex356 invoice conversation mode into digital audio signals under the control ofthe main control unit ex360 including a CPU, ROM, and RAM. Then, themodulation/demodulation unit ex352 performs spread spectrum processingon the digital audio signals, and the transmitting and receiving unitex351 performs digital-to-analog conversion and frequency conversion onthe data, so as to transmit the resulting data via the antenna ex350.Also, in the cellular phone ex114, the transmitting and receiving unitex351 amplifies the data received by the antenna ex350 in voiceconversation mode and performs frequency conversion and theanalog-to-digital conversion on the data. Then, themodulation/demodulation unit ex352 performs inverse spread spectrumprocessing on the data, and the audio signal processing unit ex354converts it into analog audio signals, so as to output them via theaudio output unit ex357.

Furthermore, when an e-mail in data communication mode is transmitted,text data of the e-mail inputted by operating the operation key unitex366 and others of the main body is sent out to the main control unitex360 via the operation input control unit ex362. The main control unitex360 causes the modulation/demodulation unit ex352 to perform spreadspectrum processing on the text data, and the transmitting and receivingunit ex351 performs the digital-to-analog conversion and the frequencyconversion on the resulting data to transmit the data to the basestation ex110 via the antenna ex350. When an e-mail is received,processing that is approximately inverse to the processing fortransmitting an e-mail is performed on the received data, and theresulting data is provided to the display unit ex358.

When video, still images, or video and audio in data communication modeis or are transmitted, the video signal processing unit ex355 compressesand codes video signals supplied from the camera unit ex365 using themoving picture coding method shown in each of embodiments (i.e.,functions as the image coding apparatus according to the aspect of thepresent disclosure), and transmits the coded video data to themultiplexing/demultiplexing unit ex353. In contrast, during when thecamera unit ex365 captures video, still images, and others, the audiosignal processing unit ex354 codes audio signals collected by the audioinput unit ex356, and transmits the coded audio data to themultiplexing/demultiplexing unit ex353.

The multiplexing/demultiplexing unit ex353 multiplexes the coded videodata supplied from the video signal processing unit ex355 and the codedaudio data supplied from the audio signal processing unit ex354, using apredetermined method. Then, the modulation/demodulation unit(modulation/demodulation circuit unit) ex352 performs spread spectrumprocessing on the multiplexed data, and the transmitting and receivingunit ex351 performs digital-to-analog conversion and frequencyconversion on the data so as to transmit the resulting data via theantenna ex350.

When receiving data of a video file which is linked to a Web page andothers in data communication mode or when receiving an e-mail with videoand/or audio attached, in order to decode the multiplexed data receivedvia the antenna ex350, the multiplexing/demultiplexing unit ex353demultiplexes the multiplexed data into a video data bit stream and anaudio data bit stream, and supplies the video signal processing unitex355 with the coded video data and the audio signal processing unitex354 with the coded audio data, through the synchronous bus ex370. Thevideo signal processing unit ex355 decodes the video signal using amoving picture decoding method corresponding to the moving picturecoding method shown in each of embodiments (i.e., functions as the imagedecoding apparatus according to the aspect of the present disclosure),and then the display unit ex358 displays, for instance, the video andstill images included in the video file linked to the Web page via theLCD control unit ex359. Furthermore, the audio signal processing unitex354 decodes the audio signal, and the audio output unit ex357 providesthe audio.

Furthermore, similarly to the television ex300, a terminal such as thecellular phone ex114 probably have 3 types of implementationconfigurations including not only (i) a transmitting and receivingterminal including both a coding apparatus and a decoding apparatus, butalso (ii) a transmitting terminal including only a coding apparatus and(iii) a receiving terminal including only a decoding apparatus. Althoughthe digital broadcasting system ex200 receives and transmits themultiplexed data obtained by multiplexing audio data onto video data inthe description, the multiplexed data may be data obtained bymultiplexing not audio data but character data related to video ontovideo data, and may be not multiplexed data but video data itself.

As such, the moving picture coding method and the moving picturedecoding method in each of embodiments can be used in any of the devicesand systems described. Thus, the advantages described in each ofembodiments can be obtained.

Furthermore, the present disclosure is not limited to the aboveembodiments, and various modifications and revisions are possiblewithout departing from the scope of the present disclosure.

Embodiment 5

Video data can be generated by switching, as necessary, between (i) themoving picture coding method or the moving picture coding apparatusshown in each of embodiments and (ii) a moving picture coding method ora moving picture coding apparatus in conformity with a differentstandard, such as MPEG-2, MPEG-4 AVC, and VC-1.

Here, when a plurality of video data that conforms to the differentstandards is generated and is then decoded, the decoding methods need tobe selected to conform to the different standards. However, since towhich standard each of the plurality of the video data to be decodedconform cannot be detected, there is a problem that an appropriatedecoding method cannot be selected.

In order to solve the problem, multiplexed data obtained by multiplexingaudio data and others onto video data has a structure includingidentification information indicating to which standard the video dataconforms. The specific structure of the multiplexed data including thevideo data generated in the moving picture coding method and by themoving picture coding apparatus shown in each of embodiments will behereinafter described. The multiplexed data is a digital stream in theMPEG-2 Transport Stream format.

FIG. 30 illustrates a structure of the multiplexed data. As illustratedin FIG. 30, the multiplexed data can be obtained by multiplexing atleast one of a video stream, an audio stream, a presentation graphicsstream (PG), and an interactive graphics stream. The video streamrepresents primary video and secondary video of a movie, the audiostream (IG) represents a primary audio part and a secondary audio partto be mixed with the primary audio part, and the presentation graphicsstream represents subtitles of the movie. Here, the primary video isnormal video to be displayed on a screen, and the secondary video isvideo to be displayed on a smaller window in the primary video.Furthermore, the interactive graphics stream represents an interactivescreen to be generated by arranging the GUI components on a screen. Thevideo stream is coded in the moving picture coding method or by themoving picture coding apparatus shown in each of embodiments, or in amoving picture coding method or by a moving picture coding apparatus inconformity with a conventional standard, such as MPEG-2, MPEG-4 AVC, andVC-1. The audio stream is coded in accordance with a standard, such asDolby-AC-3, Dolby Digital Plus, MLP, DTS, DTS-HD, and linear PCM.

Each stream included in the multiplexed data is identified by PID. Forexample, 0x1011 is allocated to the video stream to be used for video ofa movie, 0x1100 to 0x111F are allocated to the audio streams, 0x1200 to0x121F are allocated to the presentation graphics streams, 0x1400 to0x141F are allocated to the interactive graphics streams, 0x1B00 to0x1B1F are allocated to the video streams to be used for secondary videoof the movie, and 0x1A00 to 0x1A1F are allocated to the audio streams tobe used for the secondary audio to be mixed with the primary audio.

FIG. 31 schematically illustrates how data is multiplexed. First, avideo stream ex235 composed of video frames and an audio stream ex238composed of audio frames are transformed into a stream of PES packetsex236 and a stream of PES packets ex239, and further into TS packetsex237 and TS packets ex240, respectively. Similarly, data of apresentation graphics stream ex241 and data of an interactive graphicsstream ex244 are transformed into a stream of PES packets ex242 and astream of PES packets ex245, and further into TS packets ex243 and TSpackets ex246, respectively. These TS packets are multiplexed into astream to obtain multiplexed data ex247.

FIG. 32 illustrates how a video stream is stored in a stream of PESpackets in more detail. The first bar in FIG. 32 shows a video framestream in a video stream. The second bar shows the stream of PESpackets. As indicated by arrows denoted as yy1, yy2, yy3, and yy4 inFIG. 32, the video stream is divided into pictures as I pictures, Bpictures, and P pictures each of which is a video presentation unit, andthe pictures are stored in a payload of each of the PES packets. Each ofthe PES packets has a PES header, and the PES header stores aPresentation Time-Stamp (PTS) indicating a display time of the picture,and a Decoding Time-Stamp (DTS) indicating a decoding time of thepicture.

FIG. 33 illustrates a format of TS packets to be finally written on themultiplexed data. Each of the TS packets is a 188-byte fixed lengthpacket including a 4-byte TS header having information, such as a PIDfor identifying a stream and a 184-byte TS payload for storing data. ThePES packets are divided, and stored in the TS payloads, respectively.When a BD ROM is used, each of the TS packets is given a 4-byteTP_Extra_Header, thus resulting in 192-byte source packets. The sourcepackets are written on the multiplexed data. The TP_Extra_Header storesinformation such as an Arrival_Time_Stamp (ATS). The ATS shows atransfer start time at which each of the TS packets is to be transferredto a PID filter. The source packets are arranged in the multiplexed dataas shown at the bottom of FIG. 33. The numbers incrementing from thehead of the multiplexed data are called source packet numbers (SPNs).

Each of the TS packets included in the multiplexed data includes notonly streams of audio, video, subtitles and others, but also a ProgramAssociation Table (PAT), a Program Map Table (PMT), and a Program ClockReference (PCR). The PAT shows what a PID in a PMT used in themultiplexed data indicates, and a PID of the PAT itself is registered aszero. The PMT stores PIDs of the streams of video, audio, subtitles andothers included in the multiplexed data, and attribute information ofthe streams corresponding to the PIDs. The PMT also has variousdescriptors relating to the multiplexed data. The descriptors haveinformation such as copy control information showing whether copying ofthe multiplexed data is permitted or not. The PCR stores STC timeinformation corresponding to an ATS showing when the PCR packet istransferred to a decoder, in order to achieve synchronization between anArrival Time Clock (ATC) that is a time axis of ATSs, and an System TimeClock (STC) that is a time axis of PTSs and DTSs.

FIG. 34 illustrates the data structure of the PMT in detail. A PMTheader is disposed at the top of the PMT. The PMT header describes thelength of data included in the PMT and others. A plurality ofdescriptors relating to the multiplexed data is disposed after the PMTheader. Information such as the copy control information is described inthe descriptors. After the descriptors, a plurality of pieces of streaminformation relating to the streams included in the multiplexed data isdisposed. Each piece of stream information includes stream descriptorseach describing information, such as a stream type for identifying acompression codec of a stream, a stream PID, and stream attributeinformation (such as a frame rate or an aspect ratio). The streamdescriptors are equal in number to the number of streams in themultiplexed data.

When the multiplexed data is recorded on a recording medium and others,it is recorded together with multiplexed data information files.

Each of the multiplexed data information files is management informationof the multiplexed data as shown in FIG. 35. The multiplexed datainformation files are in one to one correspondence with the multiplexeddata, and each of the files includes multiplexed data information,stream attribute information, and an entry map.

As illustrated in FIG. 35, the multiplexed data information includes asystem rate, a reproduction start time, and a reproduction end time. Thesystem rate indicates the maximum transfer rate at which a system targetdecoder to be described later transfers the multiplexed data to a PIDfilter. The intervals of the ATSs included in the multiplexed data areset to not higher than a system rate. The reproduction start timeindicates a PTS in a video frame at the head of the multiplexed data. Aninterval of one frame is added to a PTS in a video frame at the end ofthe multiplexed data, and the PTS is set to the reproduction end time.

As shown in FIG. 36, a piece of attribute information is registered inthe stream attribute information, for each PID of each stream includedin the multiplexed data. Each piece of attribute information hasdifferent information depending on whether the corresponding stream is avideo stream, an audio stream, a presentation graphics stream, or aninteractive graphics stream. Each piece of video stream attributeinformation carries information including what kind of compression codecis used for compressing the video stream, and the resolution, aspectratio and frame rate of the pieces of picture data that is included inthe video stream. Each piece of audio stream attribute informationcarries information including what kind of compression codec is used forcompressing the audio stream, how many channels are included in theaudio stream, which language the audio stream supports, and how high thesampling frequency is. The video stream attribute information and theaudio stream attribute information are used for initialization of adecoder before the player plays back the information.

In the present embodiment, the multiplexed data to be used is of astream type included in the PMT. Furthermore, when the multiplexed datais recorded on a recording medium, the video stream attributeinformation included in the multiplexed data information is used. Morespecifically, the moving picture coding method or the moving picturecoding apparatus described in each of embodiments includes a step or aunit for allocating unique information indicating video data generatedby the moving picture coding method or the moving picture codingapparatus in each of embodiments, to the stream type included in the PMTor the video stream attribute information. With the configuration, thevideo data generated by the moving picture coding method or the movingpicture coding apparatus described in each of embodiments can bedistinguished from video data that conforms to another standard.

Furthermore, FIG. 37 illustrates steps of the moving picture decodingmethod according to the present embodiment. In Step exS100, the streamtype included in the PMT or the video stream attribute informationincluded in the multiplexed data information is obtained from themultiplexed data. Next, in Step exS101, it is determined whether or notthe stream type or the video stream attribute information indicates thatthe multiplexed data is generated by the moving picture coding method orthe moving picture coding apparatus in each of embodiments. When it isdetermined that the stream type or the video stream attributeinformation indicates that the multiplexed data is generated by themoving picture coding method or the moving picture coding apparatus ineach of embodiments, in Step exS102, decoding is performed by the movingpicture decoding method in each of embodiments. Furthermore, when thestream type or the video stream attribute information indicatesconformance to the conventional standards, such as MPEG-2, MPEG-4 AVC,and VC-1, in Step exS103, decoding is performed by a moving picturedecoding method in conformity with the conventional standards.

As such, allocating a new unique value to the stream type or the videostream attribute information enables determination whether or not themoving picture decoding method or the moving picture decoding apparatusthat is described in each of embodiments can perform decoding. Even whenmultiplexed data that conforms to a different standard is input, anappropriate decoding method or apparatus can be selected. Thus, itbecomes possible to decode information without any error. Furthermore,the moving picture coding method or apparatus, or the moving picturedecoding method or apparatus in the present embodiment can be used inthe devices and systems described above.

Embodiment 6

Each of the moving picture coding method, the moving picture codingapparatus, the moving picture decoding method, and the moving picturedecoding apparatus in each of embodiments is typically achieved in theform of an integrated circuit or a Large Scale Integrated (LSI) circuit.As an example of the LSI, FIG. 38 illustrates a configuration of the LSIex500 that is made into one chip. The LSI ex500 includes elements ex501,ex502, ex503, ex504, ex505, ex506, ex507, ex508, and ex509 to bedescribed below, and the elements are connected to each other through abus ex510. The power supply circuit unit ex505 is activated by supplyingeach of the elements with power when the power supply circuit unit ex505is turned on.

For example, when coding is performed, the LSI ex500 receives an AVsignal from a microphone ex117, a camera ex113, and others through an AVIO ex509 under control of a control unit ex501 including a CPU ex502, amemory controller ex503, a stream controller ex504, and a drivingfrequency control unit ex512. The received AV signal is temporarilystored in an external memory ex511, such as an SDRAM. Under control ofthe control unit ex501, the stored data is segmented into data portionsaccording to the processing amount and speed to be transmitted to asignal processing unit ex507. Then, the signal processing unit ex507codes an audio signal and/or a video signal. Here, the coding of thevideo signal is the coding described in each of embodiments.Furthermore, the signal processing unit ex507 sometimes multiplexes thecoded audio data and the coded video data, and a stream IO ex506provides the multiplexed data outside. The provided multiplexed data istransmitted to the base station ex107, or written on the recordingmedium ex215. When data sets are multiplexed, the data should betemporarily stored in the buffer ex508 so that the data sets aresynchronized with each other.

Although the memory ex511 is an element outside the LSI ex500, it may beincluded in the LSI ex500. The buffer ex508 is not limited to onebuffer, but may be composed of buffers. Furthermore, the LSI ex500 maybe made into one chip or a plurality of chips.

Furthermore, although the control unit ex501 includes the CPU ex502, thememory controller ex503, the stream controller ex504, the drivingfrequency control unit ex512, the configuration of the control unitex501 is not limited to such. For example, the signal processing unitex507 may further include a CPU. Inclusion of another CPU in the signalprocessing unit ex507 can improve the processing speed. Furthermore, asanother example, the CPU ex502 may serve as or be a part of the signalprocessing unit ex507, and, for example, may include an audio signalprocessing unit. In such a case, the control unit ex501 includes thesignal processing unit ex507 or the CPU ex502 including a part of thesignal processing unit ex507.

The name used here is LSI, but it may also be called IC, system LSI,super LSI, or ultra LSI depending on the degree of integration.

Moreover, ways to achieve integration are not limited to the LSI, and aspecial circuit or a general purpose processor and so forth can alsoachieve the integration. Field Programmable Gate Array (FPGA) that canbe programmed after manufacturing LSIs or a reconfigurable processorthat allows re-configuration of the connection or configuration of anLSI can be used for the same purpose.

In the future, with advancement in semiconductor technology, a brand-newtechnology may replace LSI. The functional blocks can be integratedusing such a technology. The possibility is that the present disclosureis applied to biotechnology.

Embodiment 7

When video data generated in the moving picture coding method or by themoving picture coding apparatus described in each of embodiments isdecoded, compared to when video data that conforms to a conventionalstandard, such as MPEG-2, MPEG-4 AVC, and VC-1 is decoded, theprocessing amount probably increases. Thus, the LSI ex500 needs to beset to a driving frequency higher than that of the CPU ex502 to be usedwhen video data in conformity with the conventional standard is decoded.However, when the driving frequency is set higher, there is a problemthat the power consumption increases.

In order to solve the problem, the moving picture decoding apparatus,such as the television ex300 and the LSI ex500 is configured todetermine to which standard the video data conforms, and switch betweenthe driving frequencies according to the determined standard. FIG. 39illustrates a configuration ex800 in the present embodiment. A drivingfrequency switching unit ex803 sets a driving frequency to a higherdriving frequency when video data is generated by the moving picturecoding method or the moving picture coding apparatus described in eachof embodiments. Then, the driving frequency switching unit ex803instructs a decoding processing unit ex801 that executes the movingpicture decoding method described in each of embodiments to decode thevideo data. When the video data conforms to the conventional standard,the driving frequency switching unit ex803 sets a driving frequency to alower driving frequency than that of the video data generated by themoving picture coding method or the moving picture coding apparatusdescribed in each of embodiments. Then, the driving frequency switchingunit ex803 instructs the decoding processing unit ex802 that conforms tothe conventional standard to decode the video data.

More specifically, the driving frequency switching unit ex803 includesthe CPU ex502 and the driving frequency control unit ex512 in FIG. 38.Here, each of the decoding processing unit ex801 that executes themoving picture decoding method described in each of embodiments and thedecoding processing unit ex802 that conforms to the conventionalstandard corresponds to the signal processing unit ex507 in FIG. 38. TheCPU ex502 determines to which standard the video data conforms. Then,the driving frequency control unit ex512 determines a driving frequencybased on a signal from the CPU ex502. Furthermore, the signal processingunit ex507 decodes the video data based on the signal from the CPUex502. For example, the identification information described inEmbodiment 5 is probably used for identifying the video data. Theidentification information is not limited to the one described inEmbodiment 5 but may be any information as long as the informationindicates to which standard the video data conforms. For example, whenwhich standard video data conforms to can be determined based on anexternal signal for determining that the video data is used for atelevision or a disk, etc., the determination may be made based on suchan external signal. Furthermore, the CPU ex502 selects a drivingfrequency based on, for example, a look-up table in which the standardsof the video data are associated with the driving frequencies as shownin FIG. 127. The driving frequency can be selected by storing thelook-up table in the buffer ex508 and in an internal memory of an LSI,and with reference to the look-up table by the CPU ex502.

FIG. 40 illustrates steps for executing a method in the presentembodiment. First, in Step exS200, the signal processing unit ex507obtains identification information from the multiplexed data. Next, inStep exS201, the CPU ex502 determines whether or not the video data isgenerated by the coding method and the coding apparatus described ineach of embodiments, based on the identification information. When thevideo data is generated by the moving picture coding method and themoving picture coding apparatus described in each of embodiments, inStep exS202, the CPU ex502 transmits a signal for setting the drivingfrequency to a higher driving frequency to the driving frequency controlunit ex512. Then, the driving frequency control unit ex512 sets thedriving frequency to the higher driving frequency. On the other hand,when the identification information indicates that the video dataconforms to the conventional standard, such as MPEG-2, MPEG-4 AVC, andVC-1, in Step exS203, the CPU ex502 transmits a signal for setting thedriving frequency to a lower driving frequency to the driving frequencycontrol unit ex512. Then, the driving frequency control unit ex512 setsthe driving frequency to the lower driving frequency than that in thecase where the video data is generated by the moving picture codingmethod and the moving picture coding apparatus described in each ofembodiment.

Furthermore, along with the switching of the driving frequencies, thepower conservation effect can be improved by changing the voltage to beapplied to the LSI ex500 or an apparatus including the LSI ex500. Forexample, when the driving frequency is set lower, the voltage to beapplied to the LSI ex500 or the apparatus including the LSI ex500 isprobably set to a voltage lower than that in the case where the drivingfrequency is set higher.

Furthermore, when the processing amount for decoding is larger, thedriving frequency may be set higher, and when the processing amount fordecoding is smaller, the driving frequency may be set lower as themethod for setting the driving frequency. Thus, the setting method isnot limited to the ones described above. For example, when theprocessing amount for decoding video data in conformity with MPEG-4 AVCis larger than the processing amount for decoding video data generatedby the moving picture coding method and the moving picture codingapparatus described in each of embodiments, the driving frequency isprobably set in reverse order to the setting described above.

Furthermore, the method for setting the driving frequency is not limitedto the method for setting the driving frequency lower. For example, whenthe identification information indicates that the video data isgenerated by the moving picture coding method and the moving picturecoding apparatus described in each of embodiments, the voltage to beapplied to the LSI ex500 or the apparatus including the LSI ex500 isprobably set higher. When the identification information indicates thatthe video data conforms to the conventional standard, such as MPEG-2,MPEG-4 AVC, and VC-1, the voltage to be applied to the LSI ex500 or theapparatus including the LSI ex500 is probably set lower. As anotherexample, when the identification information indicates that the videodata is generated by the moving picture coding method and the movingpicture coding apparatus described in each of embodiments, the drivingof the CPU ex502 does not probably have to be suspended. When theidentification information indicates that the video data conforms to theconventional standard, such as MPEG-2, MPEG-4 AVC, and VC-1, the drivingof the CPU ex502 is probably suspended at a given time because the CPUex502 has extra processing capacity. Even when the identificationinformation indicates that the video data is generated by the movingpicture coding method and the moving picture coding apparatus describedin each of embodiments, in the case where the CPU ex502 has extraprocessing capacity, the driving of the CPU ex502 is probably suspendedat a given time. In such a case, the suspending time is probably setshorter than that in the case where when the identification informationindicates that the video data conforms to the conventional standard,such as MPEG-2, MPEG-4 AVC, and VC-1.

Accordingly, the power conservation effect can be improved by switchingbetween the driving frequencies in accordance with the standard to whichthe video data conforms. Furthermore, when the LSI ex500 or theapparatus including the LSI ex500 is driven using a battery, the batterylife can be extended with the power conservation effect.

Embodiment 8

There are cases where a plurality of video data that conforms todifferent standards, is provided to the devices and systems, such as atelevision and a cellular phone. In order to enable decoding theplurality of video data that conforms to the different standards, thesignal processing unit ex507 of the LSI ex500 needs to conform to thedifferent standards. However, the problems of increase in the scale ofthe circuit of the LSI ex500 and increase in the cost arise with theindividual use of the signal processing units ex507 that conform to therespective standards.

In order to solve the problem, what is conceived is a configuration inwhich the decoding processing unit for implementing the moving picturedecoding method described in each of embodiments and the decodingprocessing unit that conforms to the conventional standard, such asMPEG-2, MPEG-4 AVC, and VC-1 are partly shared. Ex900 in FIG. 42A showsan example of the configuration. For example, the moving picturedecoding method described in each of embodiments and the moving picturedecoding method that conforms to MPEG-4 AVC have, partly in common, thedetails of processing, such as entropy coding, inverse quantization,deblocking filtering, and motion compensated prediction. The details ofprocessing to be shared probably include use of a decoding processingunit ex902 that conforms to MPEG-4 AVC. In contrast, a dedicateddecoding processing unit ex901 is probably used for other processingunique to an aspect of the present disclosure. The decoding processingunit for implementing the moving picture decoding method described ineach of embodiments may be shared for the processing to be shared, and adedicated decoding processing unit may be used for processing unique tothat of MPEG-4 AVC.

Furthermore, ex1000 in FIG. 42B shows another example in that processingis partly shared. This example uses a configuration including adedicated decoding processing unit ex1001 that supports the processingunique to an aspect of the present disclosure, a dedicated decodingprocessing unit ex1002 that supports the processing unique to anotherconventional standard, and a decoding processing unit ex1003 thatsupports processing to be shared between the moving picture decodingmethod according to the aspect of the present disclosure and theconventional moving picture decoding method. Here, the dedicateddecoding processing units ex1001 and ex1002 are not necessarilyspecialized for the processing according to the aspect of the presentdisclosure and the processing of the conventional standard,respectively, and may be the ones capable of implementing generalprocessing. Furthermore, the configuration of the present embodiment canbe implemented by the LSI ex500.

As such, reducing the scale of the circuit of an LSI and reducing thecost are possible by sharing the decoding processing unit for theprocessing to be shared between the moving picture decoding methodaccording to the aspect of the present disclosure and the moving picturedecoding method in conformity with the conventional standard.

Although the above is a description of exemplary embodiments, the scopeof the claims of the present application is not limited to thoseembodiments. Without departing from novel teaching and advantages of asubject matter described in the appended claims, various modificationsmay be made to the above embodiments, and constituent elements in theabove embodiments may be arbitrarily combined to achieve anotherembodiment, which is understood by a person skilled in the art withease. Therefore, such modifications and other embodiments are alsoincluded in the present disclosure.

INDUSTRIAL APPLICABILITY

The moving picture coding method and the moving picture decoding methodaccording to the present disclosure is applicable to any multimediadata, and can increase the processing speed of coding and decodingmoving pictures without increasing the processing load. The movingpicture coding method and the moving picture decoding method accordingto the present disclosure are useful as a moving picture coding methodand a moving picture decoding method in the storage, transmission,communication, and the like using mobile phones, DVD devices, personalcomputers, and the like, for example.

The invention claimed is:
 1. An encoding method for encoding an imageinto a bitstream, the encoding method comprising: deriving one or morecandidates for a motion vector predictor used to encode a motion vectorof a current block in the image; selecting the motion vector predictorout of the one or more candidates; and encoding an index for identifyingthe selected motion vector predictor into the bitstream, wherein thederiving includes: generating a first candidate for the motion vectorpredictor from a first motion vector of each of one or more firstadjacent blocks that are adjacent to the current block in a firstdirection; and generating a second candidate for the motion vectorpredictor from a second motion vector of each of one or more secondadjacent blocks that are adjacent to the current block in a seconddirection, the second direction being different from the firstdirection, and wherein the generating of the second candidate includes:determining for each of the one or more first adjacent blocks whether ornot the first adjacent block is inter-predicted; and scaling a scalablesecond motion vector to generate the second candidate, the scalablesecond motion vector belonging to one of the one or more second adjacentblocks, only when any of the one or more first adjacent blocks are notinter-predicted.
 2. An encoding apparatus for encoding an image into abitstream, the encoding apparatus comprising: a derivation unitconfigured to derive one or more candidates for a motion vectorpredictor used to encode a motion vector of a current block in theimage; a selection unit configured to select the motion vector predictorout of the one or more candidates; and an encoding unit configured toencode an index for identifying the selected motion vector predictorinto the bitstream, wherein the derivation unit includes: a firstcandidate generation unit configured to generate a first candidate forthe motion vector predictor from a first motion vector of each of one ormore first adjacent blocks that are adjacent to the current block in afirst direction; and a second candidate generation unit configured togenerate a second candidate for the motion vector predictor from asecond motion vector of each of one or more second adjacent blocks thatare adjacent to the current block in a second direction, the seconddirection being different from the first direction, and wherein thesecond candidate generation unit includes: a determination unitconfigured to determine for each of the one or more first adjacentblocks whether or not the first adjacent block is inter-predicted; and ascaling unit configured to scale a scalable second motion vector togenerate the second candidate, the scalable second motion vectorbelonging to one of the one or more second adjacent blocks, only whenany of the one or more first adjacent blocks are not inter-predicted. 3.An encoding apparatus for encoding an image into a bitstream, theencoding apparatus comprising: processing circuitry; and storage coupledto the processing circuitry, the processing circuitry being configuredto, using the storage: derive one or more candidates for a motion vectorpredictor used to encode a motion vector of a current block in theimage; select the motion vector predictor out of the one or morecandidates; and encode an index for identifying the selected motionvector predictor into the bitstream, wherein when deriving the one ormore candidates, the processing circuitry is configured to: generate afirst candidate for the motion vector predictor from a first motionvector of each of one or more first adjacent blocks that are adjacent tothe current block in a first direction; and generate a second candidatefor the motion vector predictor from a second motion vector of each ofone or more second adjacent blocks that are adjacent to the currentblock in a second direction, the second direction being different fromthe first direction, and wherein when generating the second candidate,the processing circuitry is configured to: determine for each of the oneor more first adjacent blocks whether or not the first adjacent block isinter-predicted; and scale a scalable second motion vector to generatethe second candidate, the scalable second motion vector belonging to oneof the one or more second adjacent blocks, only when any of the one ormore first adjacent blocks are not inter-predicted.